27 Commits

Author	SHA1	Message	Date
Arnav Agrawal	48e6aeb8b7	use local unstructured by default (#12)	2025-01-01 09:18:23 -05:00
Arnav Agrawal	abccf99974	add contextual embedding with claude prompt caching (#11) ... * add context augmentation while chunking * add contextual embeddings * default config should be combined * fix comments on PR * update example environment * update config and api to support env-variable optionality	2024-12-31 06:58:34 -05:00
Adityavardhan Agrawal	367dc079e8	Add local file system for storage (#10)	2024-12-31 06:25:51 -05:00
Adityavardhan Agrawal	3e4a9999ad	Add open telemetry and shell (#5)	2024-12-30 23:52:25 -05:00
Arnav Agrawal	0e4a43645a	reformat files	2024-12-29 12:48:41 +05:30
Arnav Agrawal	16e5decc4b	fix linting issues	2024-12-28 17:29:33 +05:30
Arnav Agrawal	b883f52a11	add ollama embeddings and test them out	2024-12-27 12:17:16 +05:30
Arnav Agrawal	418054e9a3	update configuration style to support easy model editing	2024-12-27 11:19:07 +05:30
Arnav Agrawal	13ab54fbf8	add a video parser + formatting changes (#4)	2024-12-26 11:34:24 -05:00
Adityavardhan Agrawal	03345dcc07	Add completions API (#3)	2024-12-26 08:52:25 -05:00
Arnav Agrawal	4f2f221d40	bug fixes and end-to-end testing	2024-12-17 21:40:38 -05:00
Adityavardhan Agrawal	df8d7fcdd0	refactor some stuff (#2) ... * refactor some stuff, remove bare try catches	2024-12-15 14:31:25 -05:00
Adityavardhan Agrawal	251e38828a	clean up	2024-12-04 20:26:14 -05:00
Adityavardhan Agrawal	1f68fb99d3	sdk and querying in api works	2024-12-03 21:46:25 -05:00
Arnav Agrawal	f1f52d9b67	pass api tests	2024-12-02 20:03:35 -05:00
Arnav Agrawal	000887a4dc	pass all tests apart from querying	2024-11-28 19:09:40 -05:00
Adityavardhan Agrawal	983a4ee854	separate text and doc ingestion pathways	2024-11-24 14:29:25 -05:00
Adityavardhan Agrawal	84f620437d	fix imports	2024-11-23 13:49:19 -05:00
Adityavardhan Agrawal	f7ecdc708d	SDK changes and tests	2024-11-23 13:32:47 -05:00
Adityavardhan Agrawal	d70f53cf86	system changes	2024-11-22 20:58:17 -05:00
Adityavardhan Agrawal	c3cb888aaa	add get document by id	2024-11-20 18:42:19 -05:00
Arnav Agrawal	d47240ea5c	add presigned urls fix multiple doc bug	2024-11-18 20:37:37 -05:00
Arnav Agrawal	ab4fd6def2	add document retrieval endpoint	2024-11-18 18:41:23 -05:00
Arnav Agrawal	56fe944326	add s3 uploading and fly deploy	2024-11-18 10:45:07 -05:00
Adityavardhan Agrawal	97ac012364	pdf ingestion, simplify doc, remove chunk id, content type	2024-11-17 15:38:03 -05:00
Adityavardhan Agrawal	3251236fbe	basic usage for string content works	2024-11-16 14:37:01 -05:00
Adityavardhan Agrawal	1a926c7be0	restructuring and WIP api and sdk changes	2024-11-16 01:48:15 -05:00