31 Commits

Author SHA1 Message Date
Adityavardhan Agrawal
7138094f32
Refactor Python SDK: Introduce Morphik SDK, replace DataBridge references (#75) 2025-04-09 18:46:00 -07:00
Adityavardhan Agrawal
490f342407
Add litellm support across the system (#74) 2025-04-08 00:19:47 -07:00
Adityavardhan Agrawal
f3a0ea7876
Add update graphs, and custom open ai url (#63) 2025-03-29 23:22:47 -07:00
Adityavardhan Agrawal
2436a11f29
Add entity resolution (#58) 2025-03-29 19:25:01 -07:00
Adityavardhan Agrawal
7eb5887d2f
Add hosted tier limits, cloud uri gen (#59) 2025-03-27 17:30:02 -07:00
Arnav Agrawal
f0c44cb8ea bug fixes 2025-03-26 17:08:58 -07:00
Arnav Agrawal
dc24a918a1
add honeycomb connection (#56) 2025-03-23 17:50:18 -04:00
Adityavardhan Agrawal
4ae132ff46
Implement knowledge graphs, and graph enhanced querying (#48) 2025-03-17 17:36:43 -04:00
LukeZekes
39d7bc7bfd
Include chunk score in query response and don't attempt to initialize colpali store if it is disabled (#52) 2025-03-11 15:53:42 -04:00
Arnav Agrawal
821e9d7e20
Add support for ColPali (#43)
* debug mps not supported

* further debug (i think i lost some braincells)

* fix mps bug and resolve dependency issues

* remove libmagic dependence

* add colpali embedding model

* multi-vector store works - verified with testing

* add integration testing

* support text embedding in colpali

* complete colplai integration and testing

* formatting + some PR comments

* remove experimental files

* resolve PR comments
2025-02-26 20:17:12 -05:00
Adityavardhan Agrawal
c8ed46b12b
Separate parsing and chunking into different function for easy rules processing (#41) 2025-02-15 13:02:15 -05:00
Adityavardhan Agrawal
a46fa064c7
Add natural language rules based ingestion (#34) 2025-02-07 21:08:40 -05:00
Adityavardhan Agrawal
20c3015038 Fix video parsing bugs, improve server logging 2025-01-30 16:03:46 -05:00
Adityavardhan Agrawal
f4c14fc71b
Streamline dev experience with optional auth and simplified config (#27) 2025-01-11 11:24:00 -05:00
Arnav Agrawal
f72f6f0249
Config improvements (#17) 2025-01-07 01:42:10 -05:00
Arnav Agrawal
c3726504f7
add support for PostgreSQL and pgvector (#15)
Co-authored-by: Adityavardhan Agrawal <aa729@cornell.edu>
2025-01-04 08:14:52 -05:00
Adityavardhan Agrawal
273dfcc5e7
Add PostgreSQL support (#13)
Co-authored-by: Arnav Agrawal <aa779@cornell.edu>
2025-01-04 08:11:09 -05:00
Arnav Agrawal
20faae8903
Add reranking (#14) 2025-01-02 03:42:47 -05:00
Arnav Agrawal
48e6aeb8b7
use local unstructured by default (#12) 2025-01-01 09:18:23 -05:00
Arnav Agrawal
abccf99974
add contextual embedding with claude prompt caching (#11)
* add context augmentation while chunking

* add contextual embeddings

* default config should be combined

* fix comments on PR

* update example environment

* update config and api to support env-variable optionality
2024-12-31 06:58:34 -05:00
Adityavardhan Agrawal
367dc079e8
Add local file system for storage (#10) 2024-12-31 06:25:51 -05:00
Arnav Agrawal
c672d75302 add ollama options as comments and debug env issues in config.py 2024-12-27 12:40:20 +05:30
Arnav Agrawal
b883f52a11 add ollama embeddings and test them out 2024-12-27 12:17:16 +05:30
Arnav Agrawal
418054e9a3 update configuration style to support easy model editing 2024-12-27 11:19:07 +05:30
Arnav Agrawal
13ab54fbf8
add a video parser + formatting changes (#4) 2024-12-26 11:34:24 -05:00
Adityavardhan Agrawal
03345dcc07
Add completions API (#3) 2024-12-26 08:52:25 -05:00
Arnav Agrawal
a404154650 add setup script, update readme accordingly 2024-12-23 13:22:21 -05:00
Arnav Agrawal
4f2f221d40 bug fixes and end-to-end testing 2024-12-17 21:40:38 -05:00
Adityavardhan Agrawal
251e38828a clean up 2024-12-04 20:26:14 -05:00
Adityavardhan Agrawal
1f68fb99d3 sdk and querying in api works 2024-12-03 21:46:25 -05:00
Adityavardhan Agrawal
d70f53cf86 system changes 2024-11-22 20:58:17 -05:00