Howdy — welcome to my portfolio

Matthew Osgood

Data Engineer

Building production ETL pipelines and lakehouse architectures with PySpark, Microsoft Fabric, and Delta Lake in financial services. I also ship full-stack products end-to-end and host open-source LLMs to power internal automation and decision workflows.

3+
Years in Data Engineering
$150K
Monthly Cost Saved
59
Spark Cold Starts Cut

Matthew Osgood

About Me

I'm a Data Engineer with 3+ years building production ETL/ELT pipelines and large-scale data-processing systems in financial services. I specialize in PySpark, Microsoft Fabric, and Delta Lake architectures across bronze/silver/gold lakehouse layers — cleansing, deduplicating, and transforming raw source data into reportable, well-modeled (SCD Type 2) datasets.

Much of my work is performance optimization — partitioning, clustering, and indexing to drive down compute cost — and partnering directly with business stakeholders to translate their needs into reliable data products. I've driven automation initiatives that saved roughly $150K per month and cut 59 Spark cold starts from a high-cost refresh pipeline.

Outside of the data stack, I ship full-stack products end-to-end with Next.js, Supabase, and Stripe, and I host open-source LLMs with RAG and vector search to power internal automation. I'm passionate about building practical, scalable systems that make a measurable impact.

🛢️ Lakehouse Architecture⚡ Performance Optimization🏦 FinTech

Technical Skills

Languages

PythonSQLT-SQLTypeScriptJavaScript

Data Engineering

PySparkDelta LakeMicrosoft FabricLakehouse (Bronze/Silver/Gold)SCD Type 2MERGE / COPY INTO

Databases & Warehousing

SQL ServerPostgreSQLPartitioning & ClusteringQuery Optimization

Backend & APIs

REST APIsDjango RESTNext.jsStripeJAMS Scheduler

Cloud & DevOps

AWS (SES)SupabaseVercelDockerCI/CDLinux / WSL

AI / LLMs

RAGEmbeddingsVector SearchLlama 3Prompt EngineeringFine-Tuning

Featured Projects

A mix of data engineering work and full-stack products I've shipped — from lakehouse pipelines to production SaaS.

Mortgage Lakehouse ETL on Microsoft Fabric

Production PySpark pipelines on Microsoft Fabric that ingest, cleanse, deduplicate, and transform mortgage and loan-servicing data across bronze, silver, and gold lakehouse layers. Modeled raw sources into SCD Type 2 datasets for point-in-time history and eliminated 59 Spark cold starts from a high-cost refresh, materially reducing CU consumption on an F64 capacity.

PySparkMicrosoft FabricDelta LakeSCD Type 2SQL ServerT-SQL

Sell Local — Cottage-Food SaaS Platform

Founder and full-stack engineer of a production multi-tenant SaaS for cottage-food businesses: storefronts, Stripe Connect payments, pickup ordering, a notifications hub, bio-link pages, and digital product sales. Architected end-to-end with a TypeScript/Next.js frontend, Supabase/PostgreSQL backend, and AWS SES transactional email, with live customers in production.

Next.jsTypeScriptSupabaseStripe ConnectAWS SESVercel

Mortgage Servicing AI Agents (RAG)

Hosted open-source LLMs (Llama 3) and built RAG pipelines with embeddings and vector search to replicate complex human tasks hindered by unstructured data—enabling automated document analysis, decision-making, and workflow execution to power internal automation.

PythonLlama 3RAGVector SearchLangChain

Matthew C. Molloy Memorial Foundation

Built a Next.js + Supabase + Stripe tournament registration platform with real-time updates and secure authentication for an annual charity basketball event, letting users securely donate, register, and access event details through a mobile-friendly interface.

Next.jsSupabaseStripeVercel

Sour The Bakery

Custom bakery storefront with a full-featured admin panel, empowering the owner to manage products, track and fulfill orders, and control inventory and content—streamlining day-to-day operations with an intuitive interface.

Next.jsTypeScriptFirebaseTailwind CSSVercel

Get In Touch

I'm always interested in new opportunities and collaborations. Feel free to reach out if you'd like to work together!

Let's Connect

Whether you have a project in mind, want to discuss opportunities, or just want to say hello, I'd love to hear from you.