Skip to content
View DiogoRibeiro7's full-sized avatar

Block or report DiogoRibeiro7

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
diogoribeiro7/README.md

Diogo Ribeiro

Lead Data Scientist · AI Engineer · Professor · Mathematical Engineer
20+ years in quantitative, analytical, and technical roles · United Kingdom & Portugal · Python (typed, NumPy-first)

Home (current page) Projects Methods Research Teaching

"Knowledge is knowing a tomato is a fruit; wisdom is not putting it in a fruit salad." — Miles Kington

I build end-to-end machine learning, AI, and data science systems — from data pipelines and statistical modelling through evaluation, deployment, monitoring, and business-facing decision support. The work combines mathematical and statistical depth with production engineering, with particular attention to model validation, uncertainty, interpretability, drift, and operational reliability. Alongside it I run reproducible research pipelines that turn open data into auditable evidence; when a method I need is missing from the Python ecosystem, I build it, validate it against the reference implementation, and publish it.

Delivered outcomes: 80% reduction in reporting costs · 30% reduction in analytics processing time · €500K reduction in inventory value through forecasting and operational optimisation.

I work across research, engineering, and business-facing delivery — translating complex, often messy problems into systems that can be evaluated, explained, deployed, and used to make decisions. Lean models, robust software practice, results you can reproduce and defend.

Poster with the phrase 'Data has a better idea'


Where to Go

Projects →
~70 curated repositories across AI, ML engineering, data engineering, statistics, economics, optimisation, and tooling — plus this year's highlights.
Methods →
The domains I work in, the stack I build with, and the model families I reach for, by task.
Research →
Current focus, research themes, how the programmes are built, and what I am open to collaborating on.
Teaching →
Courses at ESMAD (Instituto Politécnico do Porto), seminars, and workshop material.

What I Do

  • Production AI & LLM systems — RAG, agents, MCP servers, structured outputs, and guardrails, with evaluation, observability, and CI from the start.
  • Forecasting, anomaly detection & reliability under shift — classical to foundation-model time series, conformal intervals, drift monitoring, and models that abstain instead of guessing.
  • Statistical modelling & causal inference — calibration and uncertainty, class imbalance, cost-sensitive thresholds, and honest model selection under real-world noise.
  • Econometrics & policy research — panel and causal models, event studies, synthetic control, csQCA/fsQCA, and Monte Carlo over open economic data.
  • Optimisation & decision systems — MILP unit commitment, inventory and replenishment policy, scheduling under uncertainty, cost-weighted operating thresholds.
  • ML engineering & delivery — data pipelines, real-time analytics, serving, monitoring, and drift detection — applied across sensor and IoT modelling, healthcare analytics, and NLP.
  • Research software — methods missing from the Python ecosystem: typed, tested, validated against the reference implementation, and published with a DOI.

→ Full stack, domains, and model families on Methods.


Selected Work

  • feedback-intelligence-agent — Production-style RAG: a customer feedback intelligence agent with FastAPI, evaluation, observability, and CI.
  • hf-data-agent — Internal data agent where UI, HTTP, MCP, and Slack funnel into one Agent API, grounding an open-source model in a company knowledge base.
  • clinic-forecasting-platform — Healthcare demand forecasting: a 13-model benchmark with conformal intervals, rolling-origin backtesting, and FastAPI serving.
  • setqca — Native, typed Python csQCA/fsQCA with exact Boolean minimisation — not an R wrapper. Matches the reference R package; on PyPI with a DOI.
  • portugal-public-pension-financing — How the public pension promise was actually financed, separating legal obligations, cash accounting, and actuarial liabilities before calling anything a deficit.
  • bmssp ⭐ — Deterministic single-source shortest paths via a BMSSP-style divide-and-conquer design (typed, tested).

Live dashboards: Portugal Economic Indicators · NASDAQ Stock Analytics

→ The full catalogue and this year's highlights on Projects.


Right Now

  • Production RAG and agentic systems with evaluation, observability, and CI baked in — MCP as a first-class entrypoint alongside HTTP and Slack
  • Portuguese public finance and official statistics under audit: what the general-government balance, the pension promise, and a headline index actually measure
  • Reliability under distribution shift: conformal coverage with explicit abstention, survival-model drift monitoring, cost-weighted operating thresholds
  • Configurational methods in Python: a native csQCA/fsQCA implementation validated against R, and survey-design-aware applications across the EU-27

→ The full set of active threads on Research.


Work With Me

I teach mathematics and data subjects at ESMAD (Instituto Politécnico do Porto) and run seminars on MLOps, streaming analytics, experimentation, and forecasting — see Teaching.

Open to collaboration on production AI, reproducible policy research, robust time series, and forecast-to-decision systems — see Research. When reaching out, include a short note on your use case, constraints, and timeline so we can assess fit quickly.

Pinned Loading

  1. feedback-intelligence-agent feedback-intelligence-agent Public

    Production-style RAG system: a customer feedback intelligence agent with FastAPI, evaluation, observability, and CI

    Python

  2. ds-projects-portfolio ds-projects-portfolio Public

    Collection of end-to-end data science projects showcasing real-world analysis, modeling, and MLOps practices

    Jupyter Notebook 1

  3. ai-incident-analysis-agent ai-incident-analysis-agent Public

    AI incident analysis agent over logs and metrics with anomaly detection, correlation, root-cause analysis, and LLM-assisted reporting.

    Python 2

  4. llm-data-platform llm-data-platform Public

    Python monorepo for the LLM data lifecycle: contract-linked ingestion, dataset curation, and observability.

    Python

  5. huggingface-finetuning-lab huggingface-finetuning-lab Public

    Production-focused Hugging Face NLP fine-tuning workbench with reproducible training, robust evaluation, PEFT/LoRA, FastAPI serving, and model-card/report generation.

    Jupyter Notebook

  6. article-reminders article-reminders Public

    Public tracker for article repositories with a scheduled GitHub Action that syncs one reminder issue per unfinished article.

    Python