Skip to content

DEUS-AI/hackaton-open-overheid

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

hackaton-open-overheid-poc

DEUS Federated Data Model for Dutch Gov.

Setup

  1. Install dependencies:

Using uv (recommended):

uv sync --group dev

This installs runtime deps and dev tools like Ruff.

  1. Configure Azure Service Bus:
  • Copy .env.example to .env
  • Update the configuration with your Azure Service Bus details

Usage

Queue system

In different terminals, run the following commands:

  .venv/bin/python validation/validation.py
  .venv/bin/python pii_scanning/pii_scanning.py
  .venv/bin/python metadata_extractor/metadata_extractor.py
  .venv/bin/python data_storage/data_storage.py
  .venv/bin/python search_index/search_index.py
  .venv/bin/python notification/notification.py

To launch the initial message, run:

  .venv/bin/python data_ingestion/data_ingestion.py

Linting

  • Check lint errors:

    uv run ruff check .
  • Auto-fix what’s safe:

    uv run ruff check --fix .

Ruff is configured in pyproject.toml.

About

Pipeline for document ingestion, validation and RAG based on microservices event driven architecture

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published