Proposal & RoadMap: Extend cache runtime interface for full data lifecycle by xliuqq · Pull Request #79 · fluid-cloudnative/community

xliuqq · 2026-03-11T11:52:24Z

Add Proposal & RoadMap for 'Extend cache runtime interface for full data lifecycle'.

The work tasks are described as follows：

Curvine Integration：Implement working reference adapters for Curvine；
DataOperation Support ：Implement DataOperation interface including DataLoad and DataOperation for cache runtime；
In-Place upgrade and rebuild：Implement in-place upgrade for engine version update and in-place cache rebuild after node failure or config change.

…cycle Signed-off-by: xliuqq <xlzq1992@gmail.com>

Signed-off-by: xliuqq <xlzq1992@gmail.com>

xliuqq · 2026-03-14T14:51:09Z

@cheyang @Syspretor Please help review this. Thanks!

RongGu · 2026-03-17T08:25:30Z

proposals/runtime/v1.1.0_extend_cache_runtime/full_cache_runtime.md

+}
+type LifeCycleHook struct { 
+    // 挂载 UFS 的 hook 操作，针对 Master-Slave 架构，需要在 Master 中执行
+    MountUfs *MountUfs  `json:"mountUfs,omitempty"`


This API snippet seems internally inconsistent:Since this proposal is describing the interface contract, could we clean up this example first so it can be used as a reliable implementation reference?

rename it to "ExecutionEntries", these entries are executing at Runtime Master/Worker(if no Master) Pod to support out-of-tree integration for different cache systems.

proposals/runtime/v1.1.0_extend_cache_runtime/full_cache_runtime.md

Copilot

Pull request overview

Adds a design proposal + roadmap for extending Fluid’s CacheRuntime interface to cover a full data lifecycle, including Curvine integration, standardized DataOperation support, and in-place upgrade/rebuild capabilities.

Changes:

Added a proposal document describing the target interface changes, flows, and implementation tasks.
Added diagrams referenced by the proposal (Curvine integration flow, state transition, in-place upgrade flow).

Reviewed changes

Copilot reviewed 2 out of 5 changed files in this pull request and generated 8 comments.

File	Description
proposals/runtime/v1.1.0_extend_cache_runtime/full_cache_runtime.md	Proposal & roadmap document outlining Curvine integration, DataOperation API, and in-place upgrade/rebuild design.
proposals/runtime/v1.1.0_extend_cache_runtime/pics/state_transform.jpeg	Diagram referenced by the proposal for operation state transitions.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

proposals/runtime/v1.1.0_extend_cache_runtime/full_cache_runtime.md

Signed-off-by: xliuqq <xlzq1992@gmail.com>

Copilot

Pull request overview

Adds a new proposal document describing how to extend Fluid’s generic CacheRuntime to support full data lifecycle management (Curvine integration, standardized DataOperation, and in-place upgrade/rebuild), along with supporting diagrams.

Changes:

Add proposal markdown describing Curvine integration flow and required CacheRuntimeClass extensions.
Propose a DataOperation capability model and runtime-side operator interfaces.
Add lifecycle diagrams (state transform, in-place upgrade/rebuild flow, Curvine integration).

Reviewed changes

Copilot reviewed 2 out of 5 changed files in this pull request and generated 7 comments.

File	Description
proposals/runtime/v1.1.0_extend_cache_runtime/full_cache_runtime.md	New proposal document outlining API/flow changes for full lifecycle support.
proposals/runtime/v1.1.0_extend_cache_runtime/pics/state_transform.jpeg	Adds a state transition diagram referenced by the proposal.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

proposals/runtime/v1.1.0_extend_cache_runtime/full_cache_runtime.md

+[master]
+meta_dir = "testing/meta"
+
+# masta HA raft configuration.


proposals/runtime/v1.1.0_extend_cache_runtime/full_cache_runtime.md

+/app/curvine/lib/curvine-fuse --conf curvine-cluster.toml
+```
+
+Curvine 挂载底层文件文件时，需要等缓存系统启动完成后，显式通过命令`cv mount`执行。


proposals/runtime/v1.1.0_extend_cache_runtime/full_cache_runtime.md

+
+Curvine 挂载底层文件文件时，需要等缓存系统启动完成后，显式通过命令`cv mount`执行。
+
+### 1.2 扩展 CaceRuntime 的流程定义


proposals/runtime/v1.1.0_extend_cache_runtime/full_cache_runtime.md

+}
+type ExecutionEntries struct { 
+    // 挂载 UFS 的操作，针对 Master-Slave 架构，需要在 Master 中执行
+    MountUfs *ExecutionCommonEntry  `json:"mountUfs,omitempty"`


proposals/runtime/v1.1.0_extend_cache_runtime/full_cache_runtime.md

+```go
+type CacheRuntimeClass struct {
+    // 当前 Cache System 支持哪些数据操作
+    DataOperation	[]DataOperationSpec `json:"dataOperationSpec,omitempty"`


proposals/runtime/v1.1.0_extend_cache_runtime/full_cache_runtime.md

+
+为了保证与 TemplateEngine 的状态及处理逻辑一致，仍使用五种状态（None/Pending/Executing/Complete/Failed），其状态转换逻辑如下：
+
+<img src="pics/state_transform.jpeg" alt="img" style="zoom:80%;" />


proposals/runtime/v1.1.0_extend_cache_runtime/full_cache_runtime.md

+
+
+
+### 3. 支持 In-Place Upgrade 和 ReBuild


[Proposal][RoadMap] Extend cache runtime interface for full data life…

c56f2aa

…cycle Signed-off-by: xliuqq <xlzq1992@gmail.com>

xliuqq changed the title ~~Proposal & RoadMap Extend cache runtime interface for full data lifecycle~~ Proposal & RoadMap: Extend cache runtime interface for full data lifecycle Mar 11, 2026

Update objectives for Generic Cache Runtime

0ed91e8

Signed-off-by: xliuqq <xlzq1992@gmail.com>

xliuqq force-pushed the extend_cache_runtime branch 2 times, most recently from f4ff48a to 39064cf Compare March 12, 2026 10:02

Update Mount for CacheRuntime

64729e4

Signed-off-by: xliuqq <xlzq1992@gmail.com>

xliuqq force-pushed the extend_cache_runtime branch from 39064cf to 64729e4 Compare March 13, 2026 09:16

add ufs update and inplace update

09724fe

Signed-off-by: xliuqq <xlzq1992@gmail.com>

xliuqq force-pushed the extend_cache_runtime branch from 69d09b0 to 09724fe Compare March 14, 2026 14:47

xliuqq marked this pull request as ready for review March 14, 2026 14:48

RongGu requested a review from Copilot March 17, 2026 08:23

Copilot started reviewing on behalf of RongGu March 17, 2026 08:24 View session

RongGu reviewed Mar 17, 2026

View reviewed changes

cheyang reviewed Mar 17, 2026

View reviewed changes

proposals/runtime/v1.1.0_extend_cache_runtime/full_cache_runtime.md Outdated Show resolved Hide resolved

Copilot AI reviewed Mar 17, 2026

View reviewed changes

cheyang reviewed Mar 17, 2026

View reviewed changes

proposals/runtime/v1.1.0_extend_cache_runtime/full_cache_runtime.md Show resolved Hide resolved

cheyang reviewed Mar 17, 2026

View reviewed changes

proposals/runtime/v1.1.0_extend_cache_runtime/full_cache_runtime.md Show resolved Hide resolved

fix typo and rename LifeCycleHook to ExecutionEntries

d383dc3

Signed-off-by: xliuqq <xlzq1992@gmail.com>

xliuqq requested a review from Copilot March 17, 2026 14:17

Copilot started reviewing on behalf of xliuqq March 17, 2026 14:17 View session

Copilot AI reviewed Mar 17, 2026

View reviewed changes

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Proposal & RoadMap: Extend cache runtime interface for full data lifecycle#79

Proposal & RoadMap: Extend cache runtime interface for full data lifecycle#79
xliuqq wants to merge 5 commits intofluid-cloudnative:masterfrom
xliuqq:extend_cache_runtime

xliuqq commented Mar 11, 2026 •

edited

Loading

Uh oh!

xliuqq commented Mar 14, 2026

Uh oh!

RongGu Mar 17, 2026

Uh oh!

xliuqq Mar 17, 2026

Uh oh!

Uh oh!

Copilot AI left a comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Copilot AI left a comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants


		Curvine 挂载底层文件文件时，需要等缓存系统启动完成后，显式通过命令`cv mount`执行。

		### 1.2 扩展 CaceRuntime 的流程定义


		为了保证与 TemplateEngine 的状态及处理逻辑一致，仍使用五种状态（None/Pending/Executing/Complete/Failed），其状态转换逻辑如下：

		<img src="pics/state_transform.jpeg" alt="img" style="zoom:80%;" />

Conversation

xliuqq commented Mar 11, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

xliuqq commented Mar 14, 2026

Uh oh!

RongGu Mar 17, 2026

Choose a reason for hiding this comment

Uh oh!

xliuqq Mar 17, 2026

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

xliuqq commented Mar 11, 2026 •

edited

Loading