As a Data Engineer with a master’s degree in information technology, I specialize in designing and implementing scalable data pipelines and leveraging advanced big data technologies. My expertise spans programming languages (C, Java, Python, Scala), database management (SQL, NoSQL, PostgreSQL, Teradata), big data tools (Apache Spark, Hadoop), and cloud platforms (AWS, Azure, GCP), designing and implementing robust ETL and ELT processes.During my tenure at companies like ADP, Honeywell, PepsiCo, Network18, and MakeMyTrip, I led the development of robust data architectures and ETL workflows, utilizing tools like Apache NiFi, Apache Airflow, Talend, and Informatica. I effectively collaborated with cross-functional teams to translate business requirements into reliable data solutions, ensuring data integrity throughout.In addition to my professional experience, I have undertaken significant personal projects, such as developing real-time analytics for large-scale data sets and building data integration frameworks. My projects demonstrate my ability to handle complex data challenges and deliver actionable insights.I am passionate about driving innovation through data engineering and am open to new opportunities where I can apply my skills and continue to grow in this dynamic field. Let's connect to explore potential collaborations and opportunities.
-
Senior Data EngineerWells FargoUnited States -
Senior Data EngineerAdp Oct 2023 - PresentRichmond, Virginia, United States -
Senior Data EngineerHoneywell Jul 2021 - Sep 2023Columbus, Ohio, United States -
Senior Data EngineerPepsico Aug 2020 - Jun 2021Purchase, New York, United StatesAt PepsiCo, I researched, evaluated, and deployed tools and frameworks for sustainable Big Data platforms. I designed architecture for data services spanning relational, NoSQL, and Big Data technologies, and developed data models and data marts for the Business Intelligence Data Warehouse. I worked extensively with the Hadoop ecosystem, including HDFS, HBase, and YARN, and implemented both 3NF and dimensional data models. I utilized SSAS and SSRS for advanced SQL and data modeling, and led data migration from legacy systems. Additionally, I optimized PL/SQL code, conducted back-end testing, and performed extensive data cleansing, extraction, and analysis, ensuring efficient integration and validation of data across multiple platforms. -
Cloud EngineerNetwork18 Media & Investments Limited Sep 2016 - Nov 2019IndiaAt Network18, I was responsible for all data-related aspects of projects, from requirement gathering and JAD sessions to designing and developing data models. I optimized UML models, created relational data models, and developed star schema-based data warehouses. I wrote PL/SQL packages, stored procedures, and functions in Oracle, and designed SQL Server objects using Transact-SQL. I participated in data governance, ensuring data quality and regulatory compliance. Additionally, I created data dictionaries, performed reverse engineering of data marts, and translated business requirements into technical specifications. My role involved developing use cases, activity diagrams, and sequence diagrams using UML and Visio, as well as providing support for BI teams with SQL queries and data dictionaries. -
Data EngineerMakemytrip May 2013 - Aug 2016IndiaI have been deeply involved in data architecture and application design using cloud and big data solutions on AWS and Microsoft Azure. Leading the migration of legacy systems to Azure, I redesigned applications with minimal changes for cloud compatibility. I built data pipelines using Azure Data Factory, migrating data from legacy SQL servers to Azure databases, and integrated AWS S3 with Azure for seamless data flow. I set up Hadoop and Spark clusters for POCs, processing large datasets and integrating with Hive, HBase, and HDFS. My work includes developing Azure Web Jobs to connect various APIs for product management, loading data into Azure Data Warehouse, and writing APIs to connect media data feeds like Twitter and Facebook to Cosmos DB. I implemented a trigger-based mechanism using Azure Logic Apps and Functions to optimize resource costs and extensively worked with relational databases like PostgreSQL and Redshift. Additionally, I designed custom transformation processes using Azure Data Factory, created mapping documents, and performed ETL with Azure Data Bricks, migrating on-premise Oracle ETL processes to Azure Synapse Analytics. My expertise extends to using Azure Data Lake, Polybase, and Data Bricks for efficient data processing and storage, ensuring high-performance data engineering solutions.
Frequently Asked Questions about Meka Krishnaveni
What company does Meka Krishnaveni work for?
Meka Krishnaveni works for Wells Fargo
What is Meka Krishnaveni's role at the current company?
Meka Krishnaveni's current role is Senior Data Engineer.
Who are Meka Krishnaveni's colleagues?
Meka Krishnaveni's colleagues are Abad Abdelhamid, Wilman Reyes Sorto, Vince Cruz, Rebecca Baumbach, Abby V., Abyr Aouni, Hari Haran Subramanian.
Not the Meka Krishnaveni you were looking for?
Free Chrome Extension
Find emails, phones & company data instantly
Aero Online
Your AI prospecting assistant
Select data to include:
0 records × $0.02 per record
Download 750 million emails and 100 million phone numbers
Access emails and phone numbers of over 750 million business users. Instantly download verified profiles using 20+ filters, including location, job title, company, function, and industry.
Start your free trial