I design and implement scalable Medallion data architectures, build robust ETL pipelines, and drive business value through optimized data solutions across diverse industries.
I am a senior-level Data Engineer with extensive experience in designing and implementing Medallion data architectures within Azure and GCP environments. I possess a proven track record of building scalable ETL pipelines across the Telecommunications, Banking, E-commerce, and Mining sectors using PySpark, Apache Airflow, and Azure Databricks.
My expertise includes delivering cost-optimized solutions by integrating diverse data sources into cloud storage and managing robust, high-availability serving layers for downstream analytics. I am highly proficient in managing large-scale data migrations, implementing metadata-driven systems, and optimizing data warehouse performance to drive significant business value.
My professional journey and career highlights.
Xquisite AI
Managed end-to-end data solutions across diverse industries, including crawling, scraping, and OCR scripts. Designed a Medallion-based Data Warehouse in Azure (ADLS2, Databricks, PostgreSQL) for HR data. Engineered ETL pipelines using Apache Airflow and led data warehouse migrations from AWS to Microsoft Fabric.
Bukalapak
Designed and maintained scalable data pipelines and ETL scripts using Python and PySpark for e-commerce operations. Implemented CI/CD pipelines in GitLab and managed data security within GCP Data Projects. Collaborated closely with stakeholders on platforms like Datahub, Looker, and Databricks.
XQ Informatics
Served as a Data Engineer Consultant architecting specialized solutions for institutions like Telkom, Adira, and Bank Indonesia. Developed Python web services, social media crawling scripts, and PySpark data pipelines on the Cloudera Big Data platform, integrating custom shell scripting.
Multisoft Java Technologies
Developed and implemented automated workflows using Shell scripts to streamline job scheduling and operational efficiency. Engineered robust ETL processes utilizing Scala to handle complex data transformations.
Multisoft Java Technologies
Developed and maintained desktop-based applications using Java. Managed the full lifecycle of data reporting by building and optimizing complex queries using JasperReports, while mentoring junior programmers.
Universitas Gadjah Mada
Sep 2012 - Feb 2017
Undergraduate research published at the UGM Electronic Theses and Dissertations repository. Media and Information Division Coordinator for Himpunan Mahasiswa Statistika.
Microsoft
Mar 2021 - Mar 2024
Validated expertise in integrating, transforming, and consolidating data into analytic solutions using Azure services.
I'm always open to discussing new opportunities and data challenges. Feel free to reach out via email or phone.