add more architecture docs
This commit is contained in:
parent
045a1737f8
commit
066514e2a9
5 changed files with 141 additions and 4 deletions
14
architecture/llm_client.md
Normal file
14
architecture/llm_client.md
Normal file
|
|
@ -0,0 +1,14 @@
|
|||
# LLM Client
|
||||
|
||||
A quick wrapper over openai apis
|
||||
|
||||
## Responsibilities
|
||||
|
||||
- Transform "normal" chat/completions requests into graphs
|
||||
- Translate graphs into LLM requests
|
||||
- Keep a history of graphs parsed by it
|
||||
- On Policy Data
|
||||
- Deduplicating graphs, so we don't keep previous history as separate graphs
|
||||
|
||||
## How to use
|
||||
Exactly the same as the openai api! Just with the additional support of graph inputs and outputs.
|
||||
Loading…
Add table
Add a link
Reference in a new issue