๐ OneDE - Data Engineering Education Platform
Building the Future of Data Engineering Learning
OneDE is my passion project โ a comprehensive platform designed to help aspiring and practicing data engineers master the skills that matter. From foundational concepts to advanced cloud architectures, OneDE breaks down complex data engineering topics into clear, actionable learning paths.
Born from my own journey through the data engineering landscape, OneDE focuses on real-world skills: Azure data pipelines, PySpark transformations, SQL optimization, system design, and the technical depth needed to build production-grade data systems.
Master Data Engineering
Learn by building real data pipelines, not just watching tutorials
Welcome to Bhairus โ where curiosity meets creation ๐
I'm a Data Operations & Pipeline Engineer with 4.5+ years of experience designing, operating, and optimizing large-scale ETL and data delivery pipelines across healthcare and financial domains. Currently serving as Onsite Migration Lead at Becton Dickinson in Budapest through Tata Consultancy Services, I keep enterprise analytics platforms flowing reliably for 1,000+ global stakeholders โ and contributed $400K in annual infrastructure savings through compute optimization and pipeline performance tuning. My day-to-day spans Azure (ADF, ADLS Gen2, Azure Monitor, HDInsight), PySpark and Spark SQL, IBM DataStage, Kafka, and end-to-end pipeline ownership in regulated environments โ from production monitoring and incident response to migration cut-overs and data reconciliation frameworks. Beyond engineering, I'm building OneDE โ a data engineering education platform at onede.bhairus.com โ to share real-world knowledge and career strategies. I also run two YouTube channels: "Desh Bideshe Raja" for Bengali travel vlogs across Europe and Asia, and "Bhairus" for data engineering tutorials and EU career insights.
My LinkedIn๐ My Travel
Explore my vlogs across Europe and Asia. From the busy streets of Kolkata to the cultural heart of Budapest.
Kolkata
The vibrant city of joy and culture, my hometown.
Delhi
The chaotic charm of India's capital.
Mumbai
The city that never sleeps.
Budapest
My current home and cultural hub.
Baku
New Year fireworks special.
Vienna
Elegant streets and classic architecture.
Bratislava
A medieval day trip vlog.
๐ Desh Bideshe Raja
My Bengali travel-vlog channel โ wandering across cities, cultures, and quiet little moments, from Kolkata to Budapest and beyond.
Travel stories, told in Bangla.
From the noisy charm of Kolkata to the riverside calm of Budapest, Desh Bideshe Raja is where I capture the world in my own voice โ cultural moments, late-night walks, food, and the small details that make every place feel a little like home.
- Travels across Europe & Asia
- Bengali narration, cinematic slow vlogs
- Stories beyond just sightseeing
Featured ยท The very first video of the channel โ where the journey began.
๐ฅ Bhairus โ Featured Videos
My second channel โ data engineering tutorials, EU career insights, and tech deep-dives.
My Skills
Data Operations & Pipeline Engineer with 4.5+ years building, operating, and optimizing large-scale ETL and data delivery pipelines across healthcare and financial domains. Strong advocate for data reliability, quality engineering, and end-to-end pipeline ownership in regulated environments.
Languages & Distributed Processing
Python โ Advanced; ETL/ELT pipelines, data processing, automation
SQL โ Expert; analytical querying, data modeling, query & warehouse tuning
PySpark / Spark SQL โ Distributed processing, batch workloads, performance tuning
Shell / Unix Scripting โ Job orchestration, batch monitoring, automation
Delta Lake โ ACID storage, schema evolution, large-scale data lakes
ETL, Orchestration & Streaming
Azure Data Factory (ADF) โ Pipeline orchestration, scheduling, enterprise ETL workflows
IBM DataStage โ 50+ production ETL jobs (Informatica-equivalent tooling)
Apache Kafka โ Producer/consumer pipelines, near-real-time event processing
ETL/ELT Design โ Data modeling, validation & reconciliation frameworks (99.9% reliability)
Migration & Cut-over โ HDInsight 3.6 โ 4.0 โ 5.1 upgrades with zero data loss
Cloud, DevOps & Monitoring
Azure โ ADF, ADLS Gen2, HDInsight, Azure Monitor, Azure DevOps
AWS โ S3, Glue, Athena (data lake & analytics)
Snowflake โ Basic; warehouse modeling, SQL workloads
CI/CD & Tooling โ Git, Jenkins, Azure DevOps, Docker, Kubernetes (conceptual)
Monitoring & Observability โ Azure Monitor, pipeline alerting, log-based observability, MTTR reduction
Databases & Enterprise Systems
Databases โ SQL Server, Oracle, Snowflake, MongoDB (document fundamentals)
Enterprise Systems โ SAP, JD Edwards, Oracle ERP integration into enterprise DWHs
Certifications โ Microsoft Azure Data Engineer Associate (DP-203, 2023); Databricks Data Engineer Associate (in progress, 2026)
Contact me
Hey guys you can talk me via this email cheers.