37 Commits

Author SHA1 Message Date
Adityavardhan Agrawal
8079b6d51e
Image extraction for rules (#115) 2025-04-25 20:43:04 -07:00
Adityavardhan Agrawal
de1a7d2fd7
Staged Rule Execution (#111) 2025-04-23 23:15:03 -07:00
Adityavardhan Agrawal
792f082e05
Add structured output to completion response for query (#108) 2025-04-23 10:39:06 -07:00
Adityavardhan Agrawal
1792275cb8
Format fix, UI package update (#100)
Co-authored-by: Arnav Agrawal <aa779@cornell.edu>
2025-04-20 16:34:29 -07:00
Arnav Agrawal
25e8b8b8e9
Folder extraction (#92) 2025-04-17 20:52:18 -07:00
Adityavardhan Agrawal
be96caa303
Add folders table, add to document and other methods (#88) 2025-04-16 01:16:54 -07:00
Arnav Agrawal
3c1195e001
add task queue (#87)
* add task queue

* ensure task queuing is working as expected.

* add downstream sdk changes

* bugs and pr comments

* update docker arq running logic
2025-04-16 02:31:49 -04:00
Adityavardhan Agrawal
75556c924a
Add folders and user scopes (#82) 2025-04-13 14:52:26 -07:00
Adityavardhan Agrawal
490f342407
Add litellm support across the system (#74) 2025-04-08 00:19:47 -07:00
Adityavardhan Agrawal
bf7c90164f change document endpoint to POST, and adjust API calls for consistency 2025-04-03 10:47:34 -07:00
Adityavardhan Agrawal
08893733f6
Add custom prompt and example injections for query and graph creation (#68) 2025-03-31 21:30:48 -07:00
Adityavardhan Agrawal
f3a0ea7876
Add update graphs, and custom open ai url (#63) 2025-03-29 23:22:47 -07:00
Adityavardhan Agrawal
7eb5887d2f
Add hosted tier limits, cloud uri gen (#59) 2025-03-27 17:30:02 -07:00
Adityavardhan Agrawal
adc0b2dbb8
Add batch ingestion (#55) 2025-03-18 23:27:53 -04:00
Adityavardhan Agrawal
4ae132ff46
Implement knowledge graphs, and graph enhanced querying (#48) 2025-03-17 17:36:43 -04:00
Adityavardhan Agrawal
32a5d787fe
Add update methods with add update strategy (#53) 2025-03-13 11:26:01 -04:00
LukeZekes
39d7bc7bfd
Include chunk score in query response and don't attempt to initialize colpali store if it is disabled (#52) 2025-03-11 15:53:42 -04:00
Adityavardhan Agrawal
38683df0f3
Add completion sources and batch retrieval for docs and chunks (#51) 2025-03-09 18:42:04 -04:00
LukeZekes
e56691a1c5
add filename option for text documents (#47) 2025-03-05 10:56:02 -05:00
Arnav Agrawal
07eec6b9e3 add image processing to ollama 2025-02-26 22:36:25 -05:00
Arnav Agrawal
821e9d7e20
Add support for ColPali (#43)
* debug mps not supported

* further debug (i think i lost some braincells)

* fix mps bug and resolve dependency issues

* remove libmagic dependence

* add colpali embedding model

* multi-vector store works - verified with testing

* add integration testing

* support text embedding in colpali

* complete colplai integration and testing

* formatting + some PR comments

* remove experimental files

* resolve PR comments
2025-02-26 20:17:12 -05:00
Adityavardhan Agrawal
a46fa064c7
Add natural language rules based ingestion (#34) 2025-02-07 21:08:40 -05:00
Arnav Agrawal
d124e6aa0d
Add support for cache-augmented-generation (#30) 2025-01-28 23:49:28 -05:00
Arnav Agrawal
20faae8903
Add reranking (#14) 2025-01-02 03:42:47 -05:00
Arnav Agrawal
848198f478
fix ingestion bug (#8) 2024-12-30 11:46:42 -05:00
Arnav Agrawal
478c1acd8d
fix circular import and pydantic validation issue (#6) 2024-12-30 11:09:10 -05:00
Arnav Agrawal
0e4a43645a reformat files 2024-12-29 12:48:41 +05:30
Arnav Agrawal
80db083471 added frame/transcript augmentation for video retrieval 2024-12-29 12:45:12 +05:30
Arnav Agrawal
7830b42c6b fix typing errors 2024-12-29 11:10:51 +05:30
Arnav Agrawal
196655fea3 pipethrough video timestamps on query 2024-12-28 19:41:05 +05:30
Arnav Agrawal
13ab54fbf8
add a video parser + formatting changes (#4) 2024-12-26 11:34:24 -05:00
Adityavardhan Agrawal
03345dcc07
Add completions API (#3) 2024-12-26 08:52:25 -05:00
Adityavardhan Agrawal
df8d7fcdd0
refactor some stuff (#2)
* refactor some stuff, remove bare try catches
2024-12-15 14:31:25 -05:00
Arnav Agrawal
f1f52d9b67 pass api tests 2024-12-02 20:03:35 -05:00
Arnav Agrawal
000887a4dc pass all tests apart from querying 2024-11-28 19:09:40 -05:00
Adityavardhan Agrawal
983a4ee854 separate text and doc ingestion pathways 2024-11-24 14:29:25 -05:00
Adityavardhan Agrawal
d70f53cf86 system changes 2024-11-22 20:58:17 -05:00