|
| 1 | +# Ollama Client in Web Assembly |
| 2 | + |
| 3 | +We have implemented three export functions such as 'chunk', 'embed' and 'generate'. |
| 4 | + |
| 5 | +1. 'chunk' function to cut the text into multiple chunks |
| 6 | +``` |
| 7 | +Configuration parameters: |
| 8 | +1. chunk_size = size of the chunk, default 1024 |
| 9 | +2. chunk_overlap, number of byte overlapping, default 20 |
| 10 | +
|
| 11 | +Input: |
| 12 | +string of text input |
| 13 | +
|
| 14 | +Output: |
| 15 | +JSON Array of chunks |
| 16 | +``` |
| 17 | + |
| 18 | +2. 'embed' function to convert text into chunks of (embedding, chunk_text) pair. |
| 19 | +``` |
| 20 | +Configuration parameters: |
| 21 | +1. model, model name such as llama3.2 |
| 22 | +2. chunk_size = size of the chunk, default 1024 |
| 23 | +3. chunk_overlap, number of byte overlapping, default 20 |
| 24 | +4. address, address of the ollama host, default is http://localhost:11434. |
| 25 | +
|
| 26 | +Input: |
| 27 | +input text in string format |
| 28 | +
|
| 29 | +Output: |
| 30 | +JSON Array of Chunk with text and embedding. i.e. [{"chunk":"chunk text 1", "embedding":[1,2....]},...] |
| 31 | +``` |
| 32 | + |
| 33 | + |
| 34 | +3. 'generate' function to generate result from prompt. |
| 35 | + |
| 36 | +``` |
| 37 | +Configuration parameters: |
| 38 | +1. model, model name such as llama3.2 |
| 39 | +2. address, address of the ollama host, default is http://localhost:11434. |
| 40 | +
|
| 41 | +Input: |
| 42 | +prompt in string format |
| 43 | +
|
| 44 | +Output: |
| 45 | +JSON Array of generated text |
| 46 | +``` |
| 47 | + |
| 48 | + |
| 49 | +## Integration with MatrixOne Database |
| 50 | + |
| 51 | +``` |
| 52 | +mysql> create table chunk(t varchar, e vecf32(3072)); |
| 53 | +
|
| 54 | +mysql> insert into chunk select json_unquote(json_extract(result, "$.chunk")), json_unquote(json_extract(result, "$.embedding")) from |
| 55 | +moplugin_table('https://github.com/matrixone/mojo/raw/main/plugin/ollama/ollama.wasm', 'embed', '{"model":"llama3.2"}', 'where is great wall?') as f; |
| 56 | +
|
| 57 | +mysql> select * from moplugin_table('https://github.com/matrixone/mojo/raw/main/plugin/ollama/ollama.wasm', 'generate', '{"model":"llama3.2"}', 'where is great |
| 58 | + wall?') as f; |
| 59 | +| "The Great Wall of China is located in China, specifically along the northern border of the country. It stretches across several provinces and municipalities, including:\\n\\n1. Beijing Municipality (where the most famous and well-preserved sections are)\\n2. Tianjin Municipality\\n3. Hebei Province\\n4. Shanxi Province\\n5. Inner Mongolia Autonomous Region\\n\\nThe wall follows the mountain ranges of the northern China, winding its way through valleys and plains, and covers a total length of approximately 13,171 miles (21,196 km). It was built over several centuries to protect the Chinese Empire from invasions by nomadic tribes.\\n\\nSome popular locations to visit the Great Wall include:\\n\\n* Badaling Great Wall (near Beijing)\\n* Mutianyu Great Wall (also near Beijing)\\n* Jinshanling Great Wall (in Hebei Province)\\n* Simatai Great Wall (also in Hebei Province)\\n\\nIt's worth noting that while the wall is a UNESCO World Heritage Site and one of China's most famous landmarks, many sections have been destroyed or damaged over time due to natural erosion, human activities, or wars." | |
| 60 | +1 row in set (3.85 sec) |
| 61 | +
|
| 62 | +
|
| 63 | +``` |
0 commit comments