Where the evidence comes from.
PharoSec connects accessible public observations and keeps a record of their source, date and limitations. This directory distinguishes running connectors from research and access requirements.
A public webpage is not automatically an open dataset. No service can ingest every public post or news report: sources have different rights, access controls, languages, deletion rules and geographic coverage. The useful measure is traceable evidence and disclosed gaps.
Reporting
| Source | Access | Coverage & limits |
|---|---|---|
| GDELT GKG | Connected | English and translated-source headline discovery, refreshed every 30 minutes. Keyword coverage is incomplete; third-party article rights remain with publishers. |
| Global Voices | Connected | Two regional RSS feeds. CC BY 3.0 headlines with author, date and original link; no copied article bodies. A successful poll can return no qualifying recent story. |
| ReliefWeb / OCHA | Approval required | Humanitarian reports and situation updates. V2 requires a pre-approved appname. Partner documents retain their own rights; API access does not license every attachment. |
| UN News | Rights review | Africa RSS responded successfully in testing. Evaluate headline linking and commercial syndication terms before adding it to the paid-data pipeline. |
| Regional publishers | Rights review | Prioritise Sudan Tribune, Radio Dabanga, Radio Tamazuj, Addis Standard, The Reporter Ethiopia, Hiiraan Online, Garowe Online and African Arguments. Arrange feed permissions and keep party/state outlets explicitly attributed. |
| Reuters / AP / AFP / BBC / Al Jazeera | Licence review | Useful corroboration and multilingual coverage. Search visibility does not grant an article, photo, video or commercial syndication licence. Obtain publisher-specific feed rights. |
Social
| Source | Access | Coverage & limits |
|---|---|---|
| Telegram | Restricted | Current content-licensing terms prohibit broad scraping, aggregation and AI use. Do not run a mass channel scraper. Any consent-based submission workflow must meet the platform terms and contributors’ rights. |
| Bluesky / AT Protocol | Access blocked in test | Public search returned HTTP 403 from both the local machine and VPS. No collection is running. Resolve documented access and review storage, deletion, display and privacy rules before activation. |
| Mastodon | Instance review | Public availability varies by instance and endpoint. Start with consenting publisher accounts; honour instance policies, content licences and deletion. No universal search feed is assumed. |
| YouTube | Credentials required | Use the official Data API for discovery and compliant embeds. Credentials, quotas, deletion/refresh rules and audiovisual-download restrictions apply. Video analysis requires a separately lawful copy. |
| X | Contract required | Approved API access and a suitable plan are needed. Public display and removal rules apply; redistribution through an API is generally restricted to IDs unless another agreement permits more. |
| Commercial approval required | The Data API terms require a separate agreement for commercial uses outside the stated grant. Do not republish a scraped dataset through PharoSec’s API. | |
| Facebook / Instagram / TikTok | Eligibility and rights review | Research access is not equivalent to a commercial redistribution licence. Assess official APIs, eligible research programmes or licensed partners individually; private groups and messages are excluded. |
| Direct contributor evidence | Planned | A consent-based submission route can provide original files, capture context and permission to analyse/display. It needs moderation, source protection, withdrawal/deletion and an authenticated private review system. |
Satellite
| Source | Access | Coverage & limits |
|---|---|---|
| Sentinel-2 / Element 84 | Connected | Up to six usable 10 m optical passes per watch area within 35 days. Georeferenced crops, acquisition time, cloud metadata and source links; checked every six hours. |
| Landsat 8–9 / USGS / Planetary Computer | Connected | Up to two additional 30 m optical crops per area within 45 days. USGS scale/offset and a documented fixed display stretch are applied. Resampling does not create finer detail. |
| Sentinel-1 / Alaska Satellite Facility | Catalogue connected | Up to eight radar acquisition records per area, with orbit, polarisation, time and footprint. Raw downloads and terrain-corrected image analysis are not connected; Earthdata access and processing are separate steps. |
| NASA GIBS | Connected | Selectable daily Suomi NPP VIIRS, NOAA-20 VIIRS, Terra MODIS and Aqua MODIS context imagery. Dates identify composites, not continuous video or street-level resolution. |
| NASA FIRMS | Connected | Suomi NPP, NOAA-20 and NOAA-21 VIIRS plus Terra/Aqua MODIS observations. Sensors retain their own times, nominal resolution and confidence. Repeated detections are not independent incidents. |
| Copernicus Data Space | Alternative access | STAC/OData discovery and registered download/processing. A resilience path for the same Sentinel acquisitions, not extra independent evidence. Sentinel data rights differ from website-content rights. |
| NASA Black Marble / VIIRS night lights | Planned | Potential regional infrastructure context. Use quality flags and suitable baselines; moonlight, clouds and power availability complicate interpretation. Do not equate dimming with an attack. |
| EUMETSAT Meteosat | Access review | Frequent regional weather context can help rule out clouds and storms. Product-specific registration, resolution, cadence and use terms must be checked before integration. |
| UNOSAT / Copernicus Emergency Management | Product-level review | Published humanitarian damage and disaster assessments are useful analyst evidence. Preserve observation dates, validation caveats and each product’s attribution and redistribution terms. |
| Planet / Vantor / Airbus / ICEYE / Capella | Commercial licensing | Higher-resolution optical and radar acquisitions need provider contracts, archive/tasking budgets and explicit public-display/API redistribution rights. Do not advertise guaranteed coverage before procurement. |
Context
| Source | Access | Coverage & limits |
|---|---|---|
| HDX HAPI | Registration and dataset review | Humanitarian context with source-resource metadata. Generate an app identifier using an authorised operator contact; preserve underlying dataset-specific licences, including ACLED restrictions. |
| ACLED | Commercial agreement required | Valuable coded event data. The standard EULA is non-commercial and limits redistributable derivatives. A paid API needs explicit commercial and onward-distribution rights; events do not define control polygons. |
| UCDP | Dataset review | Historical conflict/event baselines for evaluation. Check release dates, geographic scope and the selected dataset’s licence. Historical coding is not a live control feed. |
| GDACS | Tested; not connected | The published disaster RSS responded successfully. Flood, cyclone and earthquake context can help distinguish non-conflict changes; preserve event-specific timestamps and JRC attribution. |
| OpenStreetMap / Natural Earth | Regular map and reference outlines connected | OSM standard raster tiles for interactive viewport only, with visible contributor attribution. No offline prefetch or bulk download; best-effort public tile availability. Natural Earth provides public-domain reference outlines, not territorial control. |
Maritime
| Source | Access | Coverage & limits |
|---|---|---|
| UKMTO / JMIC / IMO | Feed and rights review | Official incident notices and maritime context. Retain issue time, correction history and attributed assessments. Do not reproduce incident maps or entire notices without checking terms. |
| Global Fishing Watch / licensed AIS | Access and licence review | AIS coverage, latency and spoofing vary. A public map is not a universal live vessel API. Review account terms and onward redistribution; exclude personal vessel tracking and tactical targeting. |
| World Bank / IMF PortWatch | Dataset review | Economic baselines and aggregate port/shipping activity for commercial users. Check each dataset’s licence, revision history and lag; do not present aggregates as live vessel positions. |
Verification
| Source | Access | Coverage & limits |
|---|---|---|
| Laya | Evaluation proposed | Apache-2.0 text classification can help route review work. It cannot inspect pixels or independently verify truth. Evaluate Arabic, Amharic, Tigrinya, Somali, Oromo, English and French before deployment. |
| InVID / WeVerify | Analyst workflow | Keyframes, metadata and reverse-image investigation support manual media verification. Browser tools are not an automatically licensed bulk API; secure permission for any external lookup or media copy. |
| C2PA Content Credentials | Planned | Validate signed provenance when present. Missing credentials are not evidence of fakery, and a valid signature does not prove a pictured event or caption is true. |
Territory
| Source | Access | Coverage & limits |
|---|---|---|
| Wikimedia Commons / Sudan community territory | Connected | Five regional group fills, three initial published revisions including 3 October 2026. Source checked every six hours; newest 48 hours withheld. CC BY-SA 4.0 derived GeoJSON with full credit and conversion notes. Revision date is not whole-map verification. Original point/aircraft/contested-pattern symbols are excluded. Community accuracy and completeness are not independently verified. |
| Liveuamap / Syria and Sudan | Researched; no connected polygon feed | The Syria map is a relevant control-map precedent. About/terms permit attributed reuse of maps and polygons, while enterprise API access is separately offered. Sudan public HTML exposes no polygons, and direct client-resource research was denied (403); no access bypass or guessed boundaries. Attribution permission does not guarantee a Sudan polygon feed exists. |
| Carter Center / Syria mapping | Historical design and methodology reference | Syria mapping combined social-media analysis and expert conflict research. A useful precedent for dated territorial maps and analyst review, not a present Horn territorial data feed. |
| Sudans Post / Hiraal territorial maps | Reference; redistribution review | Sudans Post published a Sudan map dated 25 September 2026. Hiraal published a Somalia control/influence map dated 15 February 2026. Public viewing does not grant geometry or image redistribution rights; no proprietary map traced or copied. Somalia Commons alternative is disputed and dated March 2025, so not used as current. |
Territorial control
| Source | Access | Coverage & limits |
|---|---|---|
| Wikimedia Commons / Ethiopia community control map | Connected | Dated CC BY-SA 4.0 filled control areas; georeferenced and clipped to the country frame. Source checked every six hours, edits withheld for 48 hours. Community cartography, not independent verification. Umbrella categories are not disaggregated. |
| Wikimedia Commons / Yemen community control map | Connected | Dated CC BY-SA 4.0 filled control areas; georeferenced and clipped to the country frame. Source checked every six hours, edits withheld for 48 hours. Community cartography, not independent verification. Umbrella categories are not disaggregated. |
From a report to an assessment
A source record says what was observed or reported. A claim groups records that refer to the same proposed event. An assessment records what a reviewer can establish, what remains disputed and when the assessment expires. Collection and corroboration are separate steps.
- Preserve provenance. Record provider IDs, original URLs, capture/publication/collection times, language, licence and retrieval health. Keep original text separate from translations; preserve lawful originals privately with checksums and a revision history.
- Check source independence. Separate original witnesses, wire syndication, reposts and copied narratives. Thirty-two posts can originate from one video. Counts should expose record count, publisher groups and what is known about underlying evidence independence.
- Verify media context. Check lawful originals for capture metadata, earlier reuse, keyframes, language and visible contextual clues. Compare dates and geographic hypotheses against maps, weather and satellite acquisition records. Similarity and geolocation suggestions require human verification.
- Review change. Co-register comparable observations, mask clouds/shadows and compare suitable baselines. Optical colour differences, radar geometry, vegetation, flooding, construction and lighting can all resemble damage. A future change detector should produce review candidates with quality checks, never an automatic combat label.
- Publish dated assessments. City-level control assessments need at least two distinct publisher/source groups, a review note, supporting and opposing evidence, an as-of date and expiry. Current publication applies a minimum 48-hour delay. Unreviewed headline leads remain visible separately and do not assign control.
The map currently provides image comparisons, thermal observations and catalogue records. It does not run automatic damage classification, image geolocation or military tracking. Reported city assessments are linked to their underlying sources. Missing coverage is explicit; no plausible-looking territorial boundaries are generated. Two publisher groups can share underlying witnesses or agency reporting and are not guaranteed independent confirmations.
Where Laya fits
The supplied Laya model is Apache-2.0 text classification. It is a candidate for routing reports by topic, identifying statements that need review, and comparing an attributed claim with an attributed denial. It cannot inspect an image or verify an event against reality.
Its model card documents substantial zero-shot limitations. Before activation, build an analyst-labelled evaluation set for Arabic, Amharic, Tigrinya, Somali, Oromo, English and French, including negation, hearsay, historical reporting, transliteration, satire and syndicated copies. Split by event and source so near-duplicates cannot leak across train and test sets. Measure class-level precision/recall, confidence calibration and abstention; publish version and error rates. A model score describes a classification, not a probability that a village was captured.
Start with a private review assistant and a pinned model/runtime. Evaluate latency and memory on a separate worker before enabling it. No Laya inference is running on the public service yet. Training, evaluation and inference all require appropriate rights to the input data.
What the next version requires
- Approved source access. Obtain a ReliefWeb V2 appname, resolve documented social-platform access, agree publisher permissions and secure commercial redistribution rights where required. Record each grant, rate budget and deletion obligation in the source registry.
- Evidence storage and review. Add a database of observations, claims, independent source groups and assessments; a private reviewer workspace; multilingual entity resolution; correction logs; and moderated contributor submissions. Keep personal identity and source-protection data outside the public API.
- Remote-sensing evaluation. Add quality-masked spectral products and terrain-corrected radar. Benchmark change proposals against reviewed historical cases and non-conflict changes. Store model/version, baseline, thresholds and analyst outcome. Higher-resolution purchases need an archive/tasking and distribution budget.
- Public intelligence delivery. Publish evidence-linked, dated, coarse geographic assessments and corrections. Add user-selected time windows, place/category search, uncertainty filters and a timeline. Publish coverage and lag per source instead of promising continuous visibility.
- Commercial API operations. Implement authenticated access, source-specific response permissions, pagination, versioned schemas, quotas, webhooks, audit logs, availability monitoring and a service-level agreement. A purchased feed’s raw records cannot automatically be resold through an API.
A claim response should include claim_id, claim_text, place_id, event_time_range, status, record_count, independent_evidence_groups, supporting_evidence, opposing_evidence, reviewed_at, as_of, expires_at and revision. Each evidence item needs its own timestamp, source, reuse/independence group, method and rights. These fields describe the target claim schema. The current public control endpoint contains public-source city assessments, history, source groups, synthesis dates, expiry and unreviewed headline leads. A private reviewer workspace and contributor submissions are planned.
Rights and privacy
A free public map and a paid API can have different redistribution rights. Review copyright, database rights, platform contracts, privacy, defamation, sanctions/export restrictions and consumer representations for the operator’s jurisdiction and intended markets. Global users do not identify where the company is established.
Public social posts can still contain personal data or sensitive political information. Where UK/EU rules apply, assess a lawful basis, necessity, transparency, minimisation, retention, deletion requests, international transfers and whether a DPIA or special-category condition is required. A journalism exemption cannot simply be assumed for investor analytics. See the ICO’s legitimate-interests guidance and the applicable regulator’s guidance.
Maintain a correction and removal route, protect witnesses and contributors, and avoid publishing personal location trails or operational military details. State-source claims and opposition claims should be attributed consistently; source quantity and automated classification cannot guarantee freedom from propaganda. This source review is product research, not a determination of legal compliance in every country.
Faction polygons for Sudan, Ethiopia and Yemen use attributed community sources, separately labelled from city assessments. The revision date does not establish current ground truth throughout the map. Cartographic method, rights and limitations.
Read the implementation plan and this release’s delivered features.