New workshop: Process a CSV file

Feb 4, 2026·
Paloma
Paloma
· 2 min read
blog

We’re excited to announce a new intermediate-level workshop that teaches you how to build a complete data processing pipeline using Kaoto’s visual designer and Apache Camel!

What’s the Workshop About?

The Process a CSV file workshop guides you through building a real-world integration pipeline that processes healthcare patient data. You’ll work with actual data from the Synthea patient dataset and learn how to combine multiple Enterprise Integration Patterns (EIPs) to create a robust, production-ready system.

What You’ll Build

A five-route integration pipeline that demonstrates:

  • CSV Ingestion - Reading and parsing CSV files with automatic archiving
  • Data Validation - Content-based routing to filter records by data quality
  • Database Integration - Persisting valid records to PostgreSQL
  • Message Publishing - Real-time monitoring with Apache Kafka
  • Error Handling - Capturing and managing invalid records for review

The complete pipeline reads patient data from a CSV file, validates each record, stores valid data in a database, publishes to Kafka for monitoring, and captures invalid records in error files for later correction.

What You’ll Learn

This hands-on workshop covers essential integration patterns and technologies:

  • File polling and CSV data ingestion - Automated file processing with idempotent consumers
  • Content-based routing - Intelligent message routing based on data validation rules
  • Database integration - Working with PostgreSQL using Camel Kamelets
  • Message publishing - Publishing events to Apache Kafka topics
  • Error handling and data quality management - Building resilient pipelines with proper error capture

Who Is This For?

This is an intermediate-level workshop designed for developers who:

  • Have basic understanding of integration concepts and data processing pipelines
  • Are familiar with VSCode and command-line tools
  • Want to learn how to build production-ready integration solutions
  • Are interested in visual low-code development with Kaoto

Let’s Build it Together

Let us know what you think by joining us in the GitHub discussions. Do you have an idea how to improve Kaoto? Would you love to see a useful feature implemented or simply ask a question? Please create an issue.

Get Started

Happy integrating! 🚀

Kaoto Workshop CSV Processing Enterprise Integration Patterns Kafka PostgreSQL Data Pipeline Intermediate
Paloma
Authors
Paloma
Team
She is a full-stack software engineer with a background in scientific research and experience across both industry and research. She brings a thoughtful, research-driven approach to problem solving and enjoys collaborating on open-source software as part of the Kaoto team.