Caravelo
Sector: Travel subscriptions
Senior Data Engineer
August 2023 - current
Design and implementation of a Datalake with Redshift, Kinesis and DBT to process different aggregations with data from subscriptions and financial sources (Stripe, Airwallex, Bluefin, etc).
Implemented an automatized pipeline for ingestion and reporting for modeling, transformation, normalization and serving data.
Data extraction from external sources like REST APIs, Hotjar integrations, Airwallex, SQL DBs, etc.
Cross-team collaborations (ad-hoc reports for fraud or insights, data forensics for outages, alignment between teams, roadmaps, etc).
Data quality: monitor/alert data anomalies, compute and serve business metrics, detect possible outages, etc.
Data catalog: comprehensive documentation for our pipelines.
Devops practices: CI/CD, unit and end-to-end tests.