# Changelog

This changelog is generated automatically from [GitHub Releases](https://github.com/posit-dev/raghilda/releases).


# v0.2.0

*2026-06-30* · [GitHub](https://github.com/posit-dev/raghilda/releases/tag/v0.2.0)

raghilda 0.2.0 expands the package from the core RAG workflow into a more complete toolkit for building and maintaining retrieval stores. The release adds crawl and ingest APIs with caching and concurrency, a Cloudflare-backed crawler for JavaScript-rendered sites, a PostgreSQL store backend, and NVIDIA NIM embedding support.


### Added

- Added `raghilda.crawl`, including [CrawlScope](reference/crawl.CrawlScope.html#raghilda.crawl.CrawlScope), [FetchedSource](reference/crawl.FetchedSource.html#raghilda.crawl.FetchedSource), [DirectoryCrawler](reference/crawl.DirectoryCrawler.html#raghilda.crawl.DirectoryCrawler), [WebCrawler](reference/crawl.WebCrawler.html#raghilda.crawl.WebCrawler), and [CloudflareCrawler](reference/crawl.CloudflareCrawler.html#raghilda.crawl.CloudflareCrawler), for discovering directory, web, and Cloudflare sources and converting them to markdown documents.
- Added [BaseStore.ingest()](reference/store.BaseStore.html#raghilda.store.BaseStore.ingest) and `IngestSummary` for bulk document ingestion with optional document preparation, parallel writes, and inserted, replaced, and skipped counts.
- Added crawler caching so repeated or interrupted crawls can reuse fetched and converted content.
- Added [CloudflareCrawler](reference/crawl.CloudflareCrawler.html#raghilda.crawl.CloudflareCrawler) for crawling and converting JavaScript-rendered sites through Cloudflare's Browser Rendering API.
- Added [PostgreSQLStore](reference/store.PostgreSQLStore.html#raghilda.store.PostgreSQLStore), backed by `psycopg2` and `pgvector`, with full-text search, vector search, combined retrieval, attributes, and HNSW index support.
- Added `EmbeddingNVIDIA` for NVIDIA NIM embeddings, including differentiated query and document input types and rate-limit backoff.
- Added user guide pages for quickstart, crawling and ingestion, Cloudflare crawling, and chatlas integration.


### Changed

- `CrawlScope.include_patterns` and `CrawlScope.exclude_patterns` now use one glob-style pattern syntax across [DirectoryCrawler](reference/crawl.DirectoryCrawler.html#raghilda.crawl.DirectoryCrawler), [WebCrawler](reference/crawl.WebCrawler.html#raghilda.crawl.WebCrawler), and [CloudflareCrawler](reference/crawl.CloudflareCrawler.html#raghilda.crawl.CloudflareCrawler).
- Existing regex strings passed to [WebCrawler](reference/crawl.WebCrawler.html#raghilda.crawl.WebCrawler) or [DirectoryCrawler](reference/crawl.DirectoryCrawler.html#raghilda.crawl.DirectoryCrawler) should be rewritten as globs or passed as compiled `re.Pattern` objects.
- Reorganized the user guide onboarding pages and refreshed the README.


### Fixed

- Fixed sitemap URL extraction so each `<loc>` entry is collected as one URL.
- Improved DuckDB BM25 retrieval errors when the index has not been built or has become stale.


# v0.1.1

*2026-03-16* · [GitHub](https://github.com/posit-dev/raghilda/releases/tag/v0.1.1)

Initial raghilda release