RAG AI Model

Locally hosted AI models with built-in PDF parsing.

RAG AI Model
This project is an evolving process I have been working on for several months in my spare time. There are many applications for this, namely in assisting with maintenance tasks. This is how I learned about machine learning and parsing data. As it stands, the project can assist in tasks proportional to the host computer's power. Assuming the necessary hardware is present (16+ GB VRAM), the user should have no problem querying advanced maintenance/repair procedures from a manual up to several thousand pages in the database, and receive a detailed breakdown with little to no hallucination. At this time, the code has not been integrated into a GitHub repository, but I would be happy to send .py files and documentation upon request. Find my LinkedIn on this webpage footer, or my email under my resume tab.

Tech Stack

  • Ollama
  • Docker
  • Python
  • LangChain
  • ChromaDB