104 Commits

Author SHA1 Message Date
Arnav Agrawal
c56f66349e
switch to decorator pattern for telemetry (#99) 2025-04-19 19:13:51 -04:00
Adityavardhan Agrawal
09622cc3fc
Fix pytest to use redis queue, bug fixes (#98) 2025-04-19 18:24:53 -04:00
Adityavardhan Agrawal
6fcb130d58
UI improvements: direct chat with docs (#97) 2025-04-18 23:11:48 -07:00
Adityavardhan Agrawal
5b06bfa38e
Chat sources, improve logger, UI improvements (#94) 2025-04-18 00:26:27 -07:00
Arnav Agrawal
25e8b8b8e9
Folder extraction (#92) 2025-04-17 20:52:18 -07:00
Adityavardhan Agrawal
f161b7dd2a Robustify redis connection 2025-04-17 02:37:26 -07:00
Arnav Agrawal
4ffe0b3bac
Add pooling changes for scalable ingestion (#90) 2025-04-16 21:45:34 -07:00
Adityavardhan Agrawal
be96caa303
Add folders table, add to document and other methods (#88) 2025-04-16 01:16:54 -07:00
Arnav Agrawal
3c1195e001
add task queue (#87)
* add task queue

* ensure task queuing is working as expected.

* add downstream sdk changes

* bugs and pr comments

* update docker arq running logic
2025-04-16 02:31:49 -04:00
Arnav Agrawal
86ec969736 Add safety check for vector embeddings 2025-04-15 00:30:53 -07:00
Arnav Agrawal
70a93020ad add vision tag to openai gpt4o 2025-04-13 18:51:55 -07:00
Arnav Agrawal
d7b9b68eb6 bug fix 2025-04-13 16:56:57 -07:00
Arnav Agrawal
8051d7ede4 remove backslash from formatting again 2025-04-13 16:51:30 -07:00
Arnav Agrawal
9bf02fbed2 remove backslash from format file 2025-04-13 16:42:28 -07:00
Adityavardhan Agrawal
75556c924a
Add folders and user scopes (#82) 2025-04-13 14:52:26 -07:00
Arnav Agrawal
1f3df392da
billing changes for paid tiers (#83)
* billing changes for paid tiers

* PR comments

* initialize userdb on startup if in cloud mode
2025-04-13 14:11:12 -07:00
Arnav Agrawal
9a24c2e734 Fix docker PG issue 2025-04-12 22:23:10 -07:00
Adityavardhan Agrawal
40fc8fab6b
SciER Science graph evals (#81) 2025-04-12 00:24:38 -07:00
Adityavardhan Agrawal
95369635e2 Add prompt override example 2025-04-11 01:05:15 -07:00
Adityavardhan Agrawal
51f92922c3 Bug Fix: vector index dropping issue 2025-04-10 12:37:57 -07:00
Adityavardhan Agrawal
05d5fab228 Enhance alert system: add warning type and improve event handling; add Checkbox component and update dependencies 2025-04-10 12:15:43 -07:00
Adityavardhan Agrawal
e6ae047aad Improve UI: documents page, alert system, ingestion progress 2025-04-10 00:37:32 -07:00
Adityavardhan Agrawal
7138094f32
Refactor Python SDK: Introduce Morphik SDK, replace DataBridge references (#75) 2025-04-09 18:46:00 -07:00
Arnav Agrawal
0857a7f57e slice azure embeddings as well 2025-04-08 20:06:18 -07:00
Adityavardhan Agrawal
7bdc09828a Fix open ai embedding large compatibility with pgvector 2025-04-08 17:30:43 -07:00
Arnav Agrawal
975becdb00 test change: Check for existence before deletion, create table if missing, and initialize vector store in tests. 2025-04-08 00:22:00 -07:00
Adityavardhan Agrawal
490f342407
Add litellm support across the system (#74) 2025-04-08 00:19:47 -07:00
Arnav Agrawal
79865f0bd1 initialize vector store before multivector store 2025-04-06 12:48:22 -07:00
Adityavardhan Agrawal
33e77084f1 fix uri generation, remove app id from path 2025-04-04 13:36:11 -07:00
Adityavardhan Agrawal
5ae396cddb Squashed changes from hosted-service 2025-04-03 12:54:54 -07:00
Adityavardhan Agrawal
bf7c90164f change document endpoint to POST, and adjust API calls for consistency 2025-04-03 10:47:34 -07:00
Adityavardhan Agrawal
c5326fedb7 Fix uri to point to morphik api 2025-04-02 22:34:11 -07:00
Adityavardhan Agrawal
08893733f6
Add custom prompt and example injections for query and graph creation (#68) 2025-03-31 21:30:48 -07:00
Adityavardhan Agrawal
da183ea93d refactor: update test for creating graph with metadata filters 2025-03-30 17:41:05 -07:00
Arnav Agrawal
a19ff3cc5a
hotfix for document ranking in ColPali (#64)
* hotfix for document ranking in ColPali

* add re-ranking clause
2025-03-30 03:26:05 -04:00
Adityavardhan Agrawal
f3a0ea7876
Add update graphs, and custom open ai url (#63) 2025-03-29 23:22:47 -07:00
Adityavardhan Agrawal
2436a11f29
Add entity resolution (#58) 2025-03-29 19:25:01 -07:00
Adityavardhan Agrawal
9ce0507616
Add delete document endpoint (#62) 2025-03-29 18:42:52 -07:00
Adityavardhan Agrawal
6ef3ec207e Reduce extra logging, change to debugs 2025-03-27 20:05:27 -07:00
Adityavardhan Agrawal
7eb5887d2f
Add hosted tier limits, cloud uri gen (#59) 2025-03-27 17:30:02 -07:00
Arnav Agrawal
f0c44cb8ea bug fixes 2025-03-26 17:08:58 -07:00
Arnav Agrawal
dc24a918a1
add honeycomb connection (#56) 2025-03-23 17:50:18 -04:00
Adityavardhan Agrawal
adc0b2dbb8
Add batch ingestion (#55) 2025-03-18 23:27:53 -04:00
LukeZekes
5d76521059
Change in max_sim function for newer postgresql versions (#54)
* add filename option for text documents

* fix: duplicated env variables

* Include chunk score in query response

* don't initialize colpali store if one is not provided

* Add score to ChunkSource

* Add huggingface cache volume to avoid redownloads

* Replace <~> in maximum_similarity calculation

* Add dev_mode setup to default configuration

* Dump with databridge documents (no pdfs)

* Add dev_mode setup to default configuration

* Comment docker instructions for api host

* Use empty dump file
2025-03-18 14:41:39 -04:00
Adityavardhan Agrawal
4ae132ff46
Implement knowledge graphs, and graph enhanced querying (#48) 2025-03-17 17:36:43 -04:00
Arnav Agrawal
989d25d8c7 colpali hotfix 2025-03-16 17:08:38 -04:00
Adityavardhan Agrawal
32a5d787fe
Add update methods with add update strategy (#53) 2025-03-13 11:26:01 -04:00
Arnav Agrawal
62342d1b57 make compatible with python3.11 2025-03-11 20:21:08 -04:00
LukeZekes
39d7bc7bfd
Include chunk score in query response and don't attempt to initialize colpali store if it is disabled (#52) 2025-03-11 15:53:42 -04:00
Adityavardhan Agrawal
38683df0f3
Add completion sources and batch retrieval for docs and chunks (#51) 2025-03-09 18:42:04 -04:00