pathwaycom/llm-app: Trending on GitHub

Pathwaycom/LLM-App: Revolutionizing AI Applications with High-Accuracy RAG and Enterprise Search

In the rapidly evolving landscape of artificial intelligence (AI), the demand for scalable and accurate AI applications has never been higher. Pathway's AI Pipelines, a cutting-edge solution, has been trending on GitHub, offering a game-changing approach to building high-accuracy RAG (Relevance, Accuracy, and Generalization) and AI enterprise search applications. In this article, we'll delve into the world of Pathway's AI Pipelines, exploring how they work, their application templates, and the benefits they offer.

How Pathway's AI Pipelines Work

Pathway's AI Pipelines are designed to help developers and organizations quickly put in production AI applications that offer high-accuracy RAG and AI enterprise search at scale. These pipelines rely on the Pathway Live Data framework for data source synchronization and serving API requests. The framework is built on a standalone Python library with a Rust engine, providing a simple and unified application logic for back-end, embedding, retrieval, and LLM (Large Language Model) tech stack.

Application Templates

Pathway's AI Pipelines come with a range of application templates, each designed to tackle specific use cases. These templates are optimized for simplicity, accuracy, or a combination of both. Some of the application templates include:

1. Question-Answering RAG App: A basic end-to-end RAG app that uses the GPT model of choice to provide answers to queries on connected data sources.
2. Live Document Indexing (Vector Store / Retriever): A real-time document indexing pipeline for RAG that acts as a vector store service, performing live indexing on documents from connected data sources.
3. Multimodal RAG pipeline with GPT4o: A multimodal RAG using GPT-4o in the parsing stage to index PDFs and other documents from connected data sources.
4. Unstructured-to-SQL pipeline + SQL question-answering: A RAG example that connects to unstructured financial data sources, structures the data into SQL, and loads it into a PostgreSQL table.
5. Adaptive RAG App: A RAG application using Adaptive RAG, a technique developed by Pathway to reduce token cost in RAG up to 4x while maintaining accuracy.
6. Private RAG App with Mistral and Ollama: A fully private (local) version of the question_answering_rag RAG pipeline using Pathway, Mistral, and Ollama.
7. Slides AI Search App: An indexing pipeline for retrieving slides, performing multi-modal of PowerPoint and PDF and maintaining live index of your slides.

Getting Started

Each of the App templates in this repo contains a README.md with instructions on how to run it. You can also find more ready-to-run code templates on the Pathway website. To get started, simply clone the repository, install the required dependencies, and follow the instructions in the README file.

Visual Highlights

Effortlessly extract and organize table and chart data from PDFs, docs, and more with multimodal RAG - in real-time:

Automated real-time knowledge mining and alerting:

Do-it-Yourself Videos

An introduction to building LLM apps with Pathway - by Jan Chorowski

Let's build a real-world LLM app in 11 minutes - by Pau Labarta Bajo

Troubleshooting

To provide feedback or report a bug, please raise an issue on our issue tracker.

Contributing

Anyone who wishes to contribute to this project, whether documentation, features, bug fixes, code cleanup, testing, or code reviews, is very much encouraged to do so. If this is your first contribution to a GitHub project, here is a Get Started Guide.

Supported and Maintained by

Pathway's AI Pipelines are supported and maintained by a team of experts in AI and software development. The team is committed to providing high-quality support and maintenance to ensure that the pipelines continue to meet the evolving needs of developers and organizations.

In conclusion, Pathway's AI Pipelines offer a game-changing approach to building high-accuracy RAG and AI enterprise search applications. With their range of application templates, simple and unified application logic, and commitment to high-quality support and maintenance, Pathway's AI Pipelines are an ideal solution for developers and organizations looking to leverage the power of AI in their applications.

Source: https://github.com/pathwaycom/llm-app