OpenVibe.Sources

2 sources cited4 revisionsthis text accepted Not yet reviewed by a person

Imported, written with AI assistance. Imported from the OpenVibe repository README and STATUS files at the cited commits, summarised with AI assistance; originally by OpenVibers. Not yet reviewed by a person.

OpenVibe.Sources is the source registry and ingestion service of the OpenVibe network, at sources.openvibe.network on port 4720, with a loopback-only API. The README calls it "The source registry and the ingestion workers the publication products depend on."

What it does

Sources owns the one place outside material enters the network: a registry of sources with their terms, plus workers that fetch them politely and record what happened. News, Reviews, Deals, Coupons, Trade and AI summarisation all read items with provenance from here. A source records its type (rss|atom|sitemap|jsonld|api|manual), category, endpoints, auth, robots and terms notes, rate limits and indexability. Adapters parse RSS, Atom, sitemaps, JSON-LD and official APIs. Every attempt writes a fetch_runs row with an explicit state, and the README states a failed fetch is a recorded failure, never replaced by invented content. Items keep revisions and provenance, and removal is explicit.

It also keeps what a deal feed states in its own elements: DealNews' price, currency, retailer and end date become item fields exactly as written (feed@2), so OpenVibe.Deals shows them without reading prices out of headlines.

Sources today

On 2026-10-16, 35 of 39 sources were enabled, with 17,965 items from 2,156 fetch runs: 19 review sources, 4 market sources for Trade, 4 news wires, 3 hosting catalogues, 2 coupon feeds, and one each for blog desks, crowdfunding and deals.

What it does not do

Sources does not decide what a product publishes. A person reads each source's robots and terms notes before enabling it, and a source whose robots file refuses the fetch stays disabled. It never calls OpenVibe.AI.

How it fits the network

Products are the only clients of both Sources and OpenVibe.AI: a product reads items and passes them to AI as run input. Sources emits sources.item.*, sources.fetch.failed and staff-only index documents through the OpenVibe.Events outbox, and raw items reach OpenVibe.Search for staff only, always noindex. It depends on OpenVibe.Host data roles, PostgreSQL and OpenVibe.Network signing keys.

Runtime and status

Node 22 and Express on PostgreSQL 18 and Valkey 9, unit openvibe-sources.service on 127.0.0.1:4720, database ov_sources. STATUS.json records the stage as "alpha" and the service deployed. License: AGPL-3.0.

Sources

  1. OpenVibe.Sources README (commit 6a7a748), retrieved
    The source registry and the ingestion workers the publication products depend on
  2. OpenVibe.Sources STATUS.json (commit 11d9637), retrieved
    35 of 39 sources were enabled in production

Inspect these sources (retrieval times, where each was first cited, what changed between revisions)

What links here

Revision 4, saved · first published · history · JSON

Discussion

No comments yet

Start the discussion about this page.

Sign in to comment

Sign in to comment.