Conversation
@snacks is there an AI model you can feed large documents to and ask it questions about them. like i wanna be able to ask questions about the exact nature of the traffic laws here because it's very hard to read through that shit
2
0
0
@meso you'll prob need some kind of rag setup of you want to query over your entire traffic law tbh. Maybe there's some rag in a box thing but i'm not aware of any
2
0
1
@snacks why is AI such useless niggerware this is the only thing it's useful for, querying large amounts of data. AI slop haters vindicated
0
0
0
@meso retrieval augmented generation. You use vectorization to categorize parts of your text and can then draw up the closest matches and feed just those to an llm
2
0
3
@snacks @meso it might be more than you need but https://github.com/HKUDS/RAG-Anything a place to start digging
0
0
2
@meso it's not that hard to implement yourself tbh, most of my time was spent wrestling file formats and shitty microsoft webservers.
Just figure out a way to cut your documents into small enough chunks with as much meaning as possibke in tact, run it through an embedding model and save the result into a database that can handle querying vectors with like 1000 dimensions
Just figure out a way to cut your documents into small enough chunks with as much meaning as possibke in tact, run it through an embedding model and save the result into a database that can handle querying vectors with like 1000 dimensions
1
0
0
0
1
3
1
2
1
1
0
0
1
0
0
1
0
0
0
1
0