π Greetings! I'm Rishu Raj, a seasoned Data Engineer with a strong foundation in Computer Science and Engineering. Since last year, I've spearheaded transformative data engineering initiatives, leveraging cutting-edge technologies to architect robust and scalable data pipelines.π» My expertise lies in orchestrating seamless data flows, starting with Kafka as the backbone message queue system for ingesting impression data. I ensure smooth data ingestion by employing a .NET service as a Kafka Producer and Kafka Connect for efficient data transportation to Kafka topics.π οΈ From Kafka topics, I architect Java pipelines as Kafka Consumers to transfer raw data to HDFS, where another pipeline awaits to process and summarize this data. Harnessing the power of Hadoop, alongside tools like Oozie, Spark, YARN, and MapReduce, I orchestrate and execute these data workflows with precision.π Within the Ambari, I navigate and optimize the Hadoop ecosystem, fine-tuning configurations for maximum efficiency and performance. My expertise in Java is instrumental in crafting custom data pipelines tailored to meet specific business requirements and performance benchmarks.π With a relentless pursuit of excellence in data engineering, I thrive on architecting innovative solutions that unlock the full potential of data. From real-time data ingestion to batch processing and analytics, I'm committed to driving data-driven insights and fueling organizational growth.π» My academic journey has been complemented by a deep passion for crafting innovative mobile applications and web solutions. I find joy in translating ideas into user-friendly and efficient digital experiences.π± In the realm of mobile app development, I've achieved notable success, including securing AIR-1957 in the Google HashCode 2021 challenge and contributing as an ICPC'20 Regionalist for Asia (Gwalior-Pune).π Leading a team at the Bihar StartUp Conclave 2020, we introduced the "My Mess App" to combat food wastage in messes.π On the web development front, my projects include seamlessly integrated payment gateways and a modern web portfolio. I've also delved into Java, XML, Dart, Flutter Framework, and Firebase to create a College App ( BIT ALUMIN ) and an e-commerce app ( EKART ), showcasing my versatility in the tech landscape.π Let's connect and explore how we can revolutionize your data infrastructure with cutting-edge data engineering solutions! π