As a seasoned Data Engineer, I specialize in architecting and optimizing data solutions to enhance decision-making capabilities. My experience spans designing ETL pipelines, managing data integrity across various platforms, and implementing effective web scraping and API integration strategies. I am passionate about driving data governance initiatives and leveraging advanced techniques to support organizational objectives.
-
Founding EngineerProxdealGermany -
Software Engineering - Nlp, LlmAisbach Aug 2024 - PresentMunich, Bavaria, Germany -
Senior Data EngineerAlternative Path Jan 2024 - Jun 2024As a data Engineer for an investment-management firm client, I architect and optimize large-scale web scraping and ETL solutions to enhance data-driven decision-making. Leveraging advanced technologies, I focus on efficient data extraction, processing, and analysis.Key aspects of my role include:- Designing and implementing robust ETL pipelines using Scrapy, S3, Snowflake, and Apache Airflow for seamless data extraction and transformation.- Utilizing AWS (S3, EC2, CloudWatch, Lambda) for scalable cloud infrastructure and managing data storage with Snowflake and PostgreSQL for high performance.- Implementing monitoring and alerting systems with PagerDuty for quick issue resolution and minimal downtime.- Coordinating with cross-functional teams using Jira for agile project management and continuous improvement.- Leveraging additional tools like GitHub, Jenkins, Playwright, and Selenium for efficient development, testing, and deployment processes. -
Senior Member TechnicalD. E. Shaw India Private Limited Jul 2020 - May 2023Hyderabad, Telangana, IndiaAs a seasoned Data Engineer, I excel in architecting and optimizing robust data pipelines to facilitate informed decision-making in fast-paced environments. My expertise spans:- Designing and implementing scalable ETL pipelines using tools like SQLAlchemy, ensuring efficient data extraction, transformation, and loading.- Managing data integrity and validation processes across MySQL, Microsoft SQL Server, and other SQL-based environments.- Leveraging AWS services (S3, EC2, Lambda) for cloud-based solutions, enhancing data processing and management capabilities.- Implementing effective web scraping techniques and integrating REST APIs to enrich data pipelines and support analytical workflows.- Driving data governance initiatives, including metadata management, data lineage tracking, and ensuring compliance with industry standards.My proficiency in Python enables me to build sophisticated data models and streamline data ingestion processes, empowering organizations to harness their data for strategic insights and operational excellence. -
Member TechnicalD. E. Shaw India Private Limited Jul 2019 - Jun 2020Hyderabad, Telangana, India -
Data AnalystLatentview Analytics Jul 2018 - Jul 2019Chennai, Tamil Nadu, India -
Data AnalystLatentview Analytics Feb 2018 - Jun 2018Chennai, Tamil Nadu, India -
Web Development InternTimes Internet May 2016 - Jun 2016Gurugram, Haryana, India
Rohan Mitra Education Details
-
Artificial Intelligence And Data Science -
Computer Science And Engineering -
Graduate Certificate In Public Policy -
Science
Frequently Asked Questions about Rohan Mitra
What company does Rohan Mitra work for?
Rohan Mitra works for Proxdeal
What is Rohan Mitra's role at the current company?
Rohan Mitra's current role is Founding Engineer.
What schools did Rohan Mitra attend?
Rohan Mitra attended Deggendorf Institute Of Technology, Kiit University, The Takshashila Institution, Delhi Public School, Ruby Park.
Not the Rohan Mitra you were looking for?
-
-
Rohan Mitra
Jersey City, Nj2bnoinc.com, rb.com1 +190868XXXXX
-
-
3gmail.com, techmahindra.com, unimelb.edu.au
-
Rohan Mitra
Tech Maestro Transforming Data Challenges Into Seamless Solutions At Qualcomm | Java, Python, Aws Aficionado | Ex-Amazon | Let'S Innovate Together!Hyderabad
Free Chrome Extension
Find emails, phones & company data instantly
Aero Online
Your AI prospecting assistant
Select data to include:
0 records × $0.02 per record
Download 750 million emails and 100 million phone numbers
Access emails and phone numbers of over 750 million business users. Instantly download verified profiles using 20+ filters, including location, job title, company, function, and industry.
Start your free trial