About Me
Senior Data Engineer with 8+ years of experience building scalable data infrastructure and ETL pipelines. Specialized in modernizing legacy systems to distributed architectures using Hadoop, Spark, and cloud platforms.
Senior Data Engineer
Transforming data into actionable insights through robust engineering solutions.
- Focus: Data Engineering
- Experience: 8+ Years
- City: Jakarta, Indonesia
- Degree: Master IT
- Email: Joimmanuel.irfan@gmail.com
Expert in designing and implementing robust ETL pipelines using SSIS, SSAS, and SSRS. Successfully migrated enterprise systems from Sybase to distributed platforms including Hive, Dremio, Hadoop, Spark, and GCP. Strong background in Data Warehousing, Big Data architecture, and advanced Data Visualization with Power BI.
Technical Stack
Comprehensive expertise across modern data engineering technologies and tools.
Data Engineering
- Hadoop Ecosystem (HDFS, Hive, MapReduce, ZooKeeper)
- Apache Spark (Real-time Processing)
- Apache Airflow (Workflow Orchestration)
- Dremio (Data Lake Platform)
- ETL Tools (SSIS, SSAS, SSRS)
Databases & Cloud
- SQL Server / MySQL / PostgreSQL
- MongoDB (NoSQL)
- AWS & Google Cloud Platform
Programming & Visualization
- Python (Data Processing & Automation)
- Power BI (Advanced Analytics)
- Apache Superset
Soft Skills
- Technical Leadership
- Cross-functional Collaboration
- Problem Solving & Critical Thinking
- Continuous Learning & Adaptation
Professional Journey
Track record of delivering enterprise-scale data solutions.
Education
Master of Information Technology
2018 - 2020
Bina Nusantara University, Jakarta
Specialized in Big Data, Data Analytics, and Machine Learning
Bachelor of Information Technology
2013 - 2017
Bunda Mulia University, Jakarta
Focus on Software Development and Application Engineering
Certifications
Introduction to Data Science
Feb 2026 | Cisco Academy
Prompt Design in Vertex AI
Jan 2026 | Google Cloud
SQL Server SSAS (Multidimensional MDX)
Sep 2022 | Udemy
Machine Learning with Tensorflow
Aug 2022 | Digital Talent
Cloud Digital Leader (GCP)
Apr 2022 | Google Cloud
Apache Spark Essential Training
Oct 2021 | LinkedIn Learning
Data Engineering Foundations
Sep 2021 | LinkedIn Learning
Experience
Senior Data Engineer
Jul 2021 - Present (4+ years)
PT. Adicipta Inovasi Teknologi (AdIns)
- Designed and architected enterprise-grade ETL solutions using SSIS and SSAS, serving multiple multifinance clients with complex data integration requirements
- Ensured 99.9% uptime for production Advanced Reporting Services (ARS), supporting critical business operations and decision-making processes
- Led end-to-end implementation of data warehouse solutions for new clients, from requirements gathering to production deployment
- Developed and deployed machine learning pipelines for collection scoring using Apache Airflow, improving debt recovery efficiency by 25%
- Built comprehensive dashboard analytics and operational reporting in Apache Superset and PowerBI, providing real-time insights to stakeholders
- Automated unit testing frameworks using Spark and Python, reducing testing time by 40% and improving code quality
IT Big Data Supervisor
Jul 2020 - Jun 2021 (1 year)
PT. Perintis Karya Sentosa (OT Group)
- Spearheaded Big Data initiatives using Hive, Dremio, and Splice Machine, processing over 10TB of data daily
- Created automated incentive reporting systems for Sales teams, reducing manual processing time from days to hours
- Managed User Requirement Specifications (URS) and translated business needs into technical solutions, ensuring alignment with organizational goals
- Mentored junior data engineers and established best practices for data pipeline development
IT Big Data Engineer
Jan 2018 - Jun 2020 (2.5 years)
PT. Arta Boga Cemerlang (OT Group)
- Developed Business Intelligence solutions and reporting applications supporting data-driven decision making across departments
- Extracted actionable insights from large-scale datasets, contributing to strategic business initiatives
- Collaborated with cross-functional teams to resolve application and BI-related issues, ensuring seamless operations
- Optimized existing data pipelines, improving query performance by 60%
Portfolio
Selected projects showcasing technical expertise.
- Web Development
- Data Projects (Coming Soon)
Get In Touch
Open to discussing data engineering opportunities and collaborations.
Location:
Jakarta, Indonesia
Email:
Joimmanuel.irfan@gmail.com