SSARE

SSARE serves as an efficient and scalable resource for semantic search and article recommendations, catering primarily to political news data.

Active

Since 2024

Berlin

Open source: Yes

SSARE is Open Politics' data aggregation system and vector storage endpoint. It aims to create up-to-date and relevant datasets for the LLMs to work with. A microservice infrastructure continuously scrapes news sites and stores them in a vector storage and a relational database (Postgres). Sources can be added with Python scripts which yield a dataframe with: URL | Headline | Paragraphs | Source. Just clone the service, add your scripts and bring your own data endpoint into production.