Planning Flink Agents 0.1

[xintongsong]

We are targeting a MVP version of Flink Agents (0.1.0) in around end of September. That is 16 weeks from now, and here is a rough time plan.

Phase 1

• Preparation
  • Build
  • CI (GHA)
  • Contribution Guidelines
• Build a simplest agent: (x) -> (x+1)
  • [Feature][plan] Introduce Workflow, Event, Action & Callable in the Workflow Plan #11
    • [Feature][plan][python] Introduce Workflow, Event, Action & Callable in the Python Workflow Plan #12
    • [Feature][plan][java] Introduce Workflow, Event, Action & Callable in the Java Workflow Plan #13
    • [Feature][plan] Support converting between Java & Python Workflow Plans #14
  • [Feature][api] Introduce API for Workflow, Event and Action #17
    • [Feature][api][python] Introduce Python API for Workflow, Event and Action #15
    • [Feature][api][java] Introduce Java API for Workflow, Event and Action #16
  • [Feature][api] Support DataStream / Table as input / output of Flink Agents #18
    • [Feature][api][python] Support DataStream / Table as input / output of Flink Agents in Python #19
    • [Feature][api][java] Support DataStream / Table as input / output of Flink Agents in Java #20
  • [Feature][runtime] Implement a Flink operator that executes the given workflow plan #21
    • [Feature] Add the basic components required to implement feedback #25
    • [Feature] Implements agent execution operator #26
    • [Feature] Adds the support of executing the given workflow #27
    • [Feature] Adds support of Python Environment Manager #33
  • [Feature][runtime] Deploy workflow as a Flink job into a Flink cluster #22

Phase 2

• Build a simple ReAct agent
  • [Feature][plan][runtime] Introduce Resource and Resource Provider #54
    • [Feature][plan][runtime][python] Introduce Resource and Resource Provider in python #68
    • [Feature][plan][runtime][java] Introduce Resource and Resource Provider in java #69
  • [Feature][api][runtime] Support Short-Term Memory #55
  • [Feature][api] Introduce Prompt, Tool and ChatModel #56
    • [Feature][api][python] Introduce Prompt, Tool and ChatModel in Python #76
    • [Feature][api][java] Introduce Prompt, Tool and ChatModel in java #77
  • [Feature][api][python] Support ReAct Agent in Python #57
  • [Feature] [api][plan][java] Support built-in ReAct Agent in Java. #189

Phase 3

• Developing
  • [Feature] Support MCP integration #111
  • Provide more built-in implementations for ChatModel
    • [Feature] [integration] Support built-in ollama chat model in python. #89
    • [Feature] [integration][python] Integrate built-in tongyi chatmodel. #119
    • [Feature] [integration][python] Integrate built-in openai chat model. #120
    • [Feature] [integration][python] Integrate built-in Anthropic chat model. #129
    • [Feature] [integrations][java] Add support for OllamaChatModel #157
  • Embedding Model
    • [Feature] [Integration] Add Embedding Model abstraction and provide a built-in Ollama embedding model implementation #149
    • [Feature] [integration][python] OpenAI embedding model integration #166
  • Vector Store
    • [Feature] support VectorStore and provide a built-in Chroma implementation #130
    • [Feature] Support Chroma Cloud #187
  • Long-term memory - @coderplay
  • [optional] Hierarchy Agent
• Execution
  • [Feature][runtime] Support async execution for actions #58
    • [Feature][runtime][python] Support async execution for actions in python #86
    • [Feature][runtime][java] Support async execution for actions in java #87
  • [Feature] Replay-based Per Action State Consistency #151
    • [Feature] Introduce ActionState related APIs #152
    • [Feature] Provide Kafka-based implementation of ActionState #153
  • [optional] Cross-language invocation
• Operation
  • [Feature][api][runtime] Introduce metric mechanism #59
  • [Feature][api][runtime] Introduce configuration mechanism #118
  • log
    • Release Flink 1.20.3
  • [Feature] [api] Support Event Logger and Event Listener in Java #102 - @alnzng
  • [optional] Local python runtime

Phase 4

• [Feature] [Docs] Set up Flink Agents Document Website #154
• Add example agents
  • [python][examples] Add quickstart workflow examples #158
  • [Feature] [example] Implement ReAct Agent quick start example #210
  • [example][java] Add single agent example #225
  • [example][java] Add ReAct agent example #242
• Documentation
  • [Docs] Draft the barebones of project docs #191
  • [Feature][docs] Flink-Agents MVP version project docs umbrella #196
    • Get Started
      • [Feature][docs] Get Started - Overview docs #197
      • [Feature][docs] Get Started - Installation docs #198
      • [Feature][docs] Get Started - Quickstart - ReAct Agent docs #199
      • [Feature][docs] Get Started - Quickstart - Workflow Agent docs #200
    • How to build an agent
      • [Feature][docs] How to build an agent - ReAct Agent docs #201
      • [Feature][dosc] How to build an agent - Workflow Agent docs #202
      • [Feature][docs] How to build an agent - Chat with LLM docs #203
      • [Feature][docs] How to build an agent - Embedding and Vector Store docs #204
      • [Feature][docs] How to build an agent - Use a Tool docs #205
      • [Feature][docs] How to build an agent - Integrate with Flink docs #206
    • How to run an agent
      • [Feature][docs] How to run an agent - Deployment docs #207
      • [Feature][docs] How to run an agent - Configuration docs #208
      • [Feature][docs] How to run an agent - Monitoring docs #209
• [Feature] [package] Refactor the packaging of Flink-Agents. #193