Commit Graph
104 Commits
Author SHA1 Message Date
Timothy Jaeryang Baek 61f29a6531 Merge branch 'main' into dev 2024-11-11 13:45:13 -08:00
Timothy Jaeryang Baek 96c865404d refac: disable openapi.json 2024-11-09 18:01:23 -08:00
Timothy J. Baek a4abd32e4a fix 2024-11-06 23:01:10 -08:00
Timothy J. Baek f8c2bedf53 fix: hybrid search 2024-11-06 22:51:36 -08:00
Jason Kidd 319ea8cb7f feat: Add ability to set URI for pgvector 2024-11-04 14:27:33 -08:00
Jason Kidd 701f40aedd feat: Initial support for pgvector 2024-11-04 14:26:41 -08:00
Timothy Jaeryang Baek 6c1d0a8e39 Merge pull request #6598 from dtaivpp/main
feat: OpenSearch vector db support
2024-11-04 14:04:55 -08:00
David Tippett 705e3129b6 Updating config format. 2024-11-04 15:14:53 -05:00
David Tippett afca48028f Moving new config to under retreval 2024-11-04 15:10:14 -05:00
Davi Sclifo Zucon a70e5a0f30 When UI "Bypass SSL verification for Websites"=True then ENABLE_RAG_WEB_LOADER_SSL_VERIFICATION=False 2024-11-04 16:29:29 -03:00
Davi Sclifo Zucon 35a9140567 Added parameter to: app.state.config.ENABLE_RAG_WEB_LOADER_SSL_VERIFICATION to get_web_loader(verify_ssl).
Invert variable value to send to UI , not ENABLE_RAG_WEB_LOADER_SSL_VERIFICATION.
2024-11-04 16:21:26 -03:00
Davi Sclifo Zucon 5306b49be0 Small Fix variable ssl_verification -> web_loader_ssl_verification (following python entity)
When changed via the web interface in Admin's WebSearch, the bypass option is not being persisted.
This change adjusts it to the same name as the one related in the python entity.
2024-11-04 15:40:16 -03:00
Timothy J. Baek 5c60081c1f refac: web search 2024-11-03 17:07:24 -08:00
Timothy J. Baek f1065115aa fix: youtube loader issue 2024-11-03 03:18:17 -08:00
Timothy J. Baek 380e080f6d fix: do not crash on invalid embedding model 2024-11-03 01:08:04 -08:00
David Tippett fb30b667e2 First pass at an OpenSearch connector 2024-10-30 15:51:56 -04:00
Timothy Jaeryang Baek adfce28732 Merge pull request #6543 from execgit/main
fix: omit document contents in logging document embedding
2024-10-29 19:17:53 -07:00
execgit 03e9add96d retrieval.utils: omit logging file contents at level INFO 2024-10-29 14:33:37 +02:00
execgit bc7622c0fe Avoid logging file contents at level INFO
I had problems with document handling in rootless containers. Long documents caused the container to hang. Reducing the verbosity of logging from retrieval.main seemed to fix the issues I was experiencing.
2024-10-29 14:31:47 +02:00
Timothy Jaeryang Baek b32fbf7c58 Merge pull request #6504 from jeeteshchel/fork/dev
feat: enable bing support
2024-10-28 12:30:11 -07:00
Jeetesh Chellani f7d8a6ccba feat: enable bing support 2024-10-28 16:51:31 +02:00
Timothy J. Baek 491cff8c63 refac: parse md files with TextLoader 2024-10-28 05:50:56 -07:00
Diwakar Singh Maurya 3d0c32f366 feature to support authentication in chromadb 2024-10-27 14:01:00 +07:00
Timothy J. Baek f2c78ac0fb refac 2024-10-25 22:23:21 -07:00
Timothy J. Baek 47e4250f58 refac 2024-10-25 22:12:46 -07:00
Timothy J. Baek 076c54c486 refac 2024-10-25 21:47:47 -07:00
Timothy J. Baek 780591e991 refac 2024-10-25 21:46:14 -07:00
Timothy J. Baek 50dcad0f73 fix: tiktoken encoding model issue 2024-10-25 21:38:28 -07:00
Timothy J. Baek e43e91edd3 refac 2024-10-20 23:45:15 -07:00
Timothy J. Baek 9936583477 chore: format 2024-10-20 18:38:06 -07:00
Timothy J. Baek 4d46bfe03b refac: file table migration 2024-10-20 17:45:37 -07:00
Timothy Jaeryang Baek c9c79852a5 Merge branch 'dev' into dev 2024-10-17 13:25:39 -07:00
Timothy J. Baek 6336d34b59 fix: web attachment issue 2024-10-17 13:08:10 -07:00
Timothy J. Baek 8eb45acf10 refac 2024-10-14 18:47:41 -07:00
Jannik Streidl f0f4de59eb Merge branch 'upstream-dev' into dev 2024-10-14 09:50:40 +02:00
Timothy J. Baek 586e005f0f enh: token text splitter support 2024-10-13 04:24:13 -07:00
Timothy J. Baek 8a0da6d376 enh: include file name to context 2024-10-13 03:58:51 -07:00
Timothy J. Baek 797afd0b72 fix: embedding metadata issue 2024-10-13 03:25:11 -07:00
Timothy J. Baek 92605fd59f refac 2024-10-13 03:16:18 -07:00
Timothy J. Baek 5ffd216fca refac 2024-10-13 03:02:02 -07:00
Timothy J. Baek dff3732fcd enh: tiktoken/token splitter support 2024-10-13 02:07:50 -07:00
Timothy J. Baek 5273dc4535 refac 2024-10-13 00:21:06 -07:00
Timothy J. Baek 333317a7ce refac: add embedding metadata 2024-10-12 18:30:21 -07:00
Jannik Streidl f47c9c69e3 Merge branch 'upstream-dev' into dev 2024-10-12 15:18:59 +02:00
Jannik Streidl 741230bcdb fix 2024-10-10 17:20:50 +02:00
Jannik Streidl 89c77f05a8 chromadb switch to cosine similarity 2024-10-10 16:46:14 +02:00
Timothy Jaeryang Baek d7a71f3b34 Merge pull request #6050 from RobinBially/main
feat: add qdrant vector db connector
2024-10-09 12:12:48 -07:00
Timothy J. Baek c157004e07 refac 2024-10-09 12:05:16 -07:00
Timothy J. Baek 451f1bae15 refac: embeddings function 2024-10-09 11:41:35 -07:00
Robin Bially 34150fc3ed add NO_LIMIT var 2024-10-09 18:34:04 +02:00