Varun Kumar Email & Phone Number

New York, United States

I am an accomplished Data Engineer and Architect with extensive experience in designing and implementing robust data architectures and solutions. My expertise spans across multiple technologies and platforms including AWS, Azure, Hadoop, and Spark, allowing me to effectively address complex data challenges and drive significant business value.🔹 Data Architecture & Management: I have a proven track record in designing and leading data architecture strategies, ensuring the synchronization of data from multiple sources, and enhancing data quality and management processes. My role involved system analysis, requirements gathering, and providing impact analysis for improvements.🔹 Big Data & Cloud Solutions: I spearhead big data initiatives and cloud-based solutions, utilizing AWS and Azure to architect data pipelines, create data models, and perform advanced analytics. I’ve designed real-time stream processing applications using Spark, Kafka, Scala, and Hive, and developed ETL processes using AWS Glue and Python.🔹 ETL & Data Processing: My hands-on experience includes developing and maintaining ETL scripts in Python and Perl, performing data extraction, transformation, and loading into MySQL and AWS Redshift. I have created and managed Spark clusters, Hive tables, and used Airflow for job scheduling and monitoring.🔹 Advanced Analytics & Machine Learning: I’ve leveraged tools like Tableau for data visualization and applied machine learning algorithms in real-time streaming applications to derive actionable insights from complex datasets.🔹 Automation & Optimization: I have automated various processes using Shell, Perl, and Python scripts and optimized data workflows to enhance performance and efficiency. My work includes implementing data partitioning, bucketing, and managing data in HDFS and Hive.

New Jersey, United States

As an accomplished Data Engineer and Architect with extensive experience in both AWS and Azure ecosystems, I specialize in optimizing and managing complex data environments to drive performance and business value. My expertise includes tuning Redshift environments for up to 100x faster query performance, designing robust ETL flows with DataStage, and implementing scalable big data solutions using Spark, Hadoop, and Azure. I excel in creating advanced data models, managing full lifecycle Data Lake and Warehouse projects, and developing real-time and batch analytics solutions. My skills extend to automating processes with AWS CloudFormation, scripting in Python and Scala, and leveraging tools like SSRS and Tableau for insightful reporting. Committed to delivering high-impact data solutions, I am passionate about solving intricate data challenges and enhancing organizational efficiency through innovative technologies.

Minneapolis, Minnesota, United States

Business Data Requirements Gathering: Collaborate with users, developers, and architects to gather and analyze business data needs; model these requirements to meet stakeholder expectations.AWS Infrastructure Management: Provision and manage AWS EC2 instances; deploy applications using Elastic Load Balancing (ELB) for scalable, reliable performance.Data Warehouse Design: Utilize Bill Inmon and Ralph Kimball methodologies for designing data warehouses and data marts; implement Star Schema and Snowflake Schema for dimensional modeling.AWS Tools: Leverage Amazon EMR for big data processing, Amazon S3 for scalable storage, and Amazon CloudWatch for monitoring and managing resources.Data Modeling: Design logical and physical data models using Erwin; create comprehensive metadata to support business requirements and optimize performance.ETL Development: Develop and maintain ETL processes using Unix shell scripting, Perl DBI/DBD, and SAP Data Services; scrape data from websites and populate databases.Python and Data Migration: Use Python for data extraction from Oracle and loading into Snowflake; manage data migration and integration across platforms.Data Mart and OLAP: Design OLAP data models; implement slowly changing dimensions (SCD); work on data marts within Enterprise Data Warehouse (EDW) projects.Advanced Data Modeling: Develop 3NF target data models, validate data with ANSI SQL, and design MOLAP/ROLAP cubes using SSAS.Automation and Integration: Create automated ETL procedures with SSIS; perform data analysis and profiling on various source systems.AWS RDS and Documentation: Manage data on AWS RDS; develop mapping spreadsheets for ETL processes and document transformation rules.Handling Slowly Changing Dimensions: Track and manage SCD types and hierarchies in dimensions for accurate historical data management.

Chicago, Illinois, United States

Requirements Gathering and Data Modeling: Attended sessions to gather and translate business requirements into logical and physical data models for Data Warehouses, Data Marts, and OLAP applications.Data Analysis and Validation: Performed extensive data analysis and validation on Teradata; designed Star and Snowflake Data Models using ERWIN.Logical Data Model Creation: Created and maintained Logical Data Models (LDMs) including documentation of entities, attributes, relationships, keys, values, codes, business rules, and glossary terms.ETL Processes and Data Integration: Integrated data from MS SQL Server, DB2, Oracle, Netezza, and Teradata using Informatica for ETL processes; also worked with SSIS, SQL Loader, and PL/SQL for ETL development and data migration.Entity/Relationship Diagrams: Created ER Diagrams, grouped and created tables, validated data, and identified primary keys for lookup tables.XML Data Extraction: Developed components to extract application messages from XML files.ETL Tool Usage: Utilized Informatica for populating databases and transforming data from old to new databases using Oracle.Dimensional Modeling and Performance Tuning: Designed Star Schema models, built dimensional data models, and performed performance tuning and index maintenance.Data Warehouse and Metadata Management: Created and maintained Data Warehouse structures and metadata repositories.Testing and Validation: Wrote and executed unit, system, integration, and UAT scripts; verified data migration and integrity with SQL queries.Stored Procedures and Triggers: Created and modified T-SQL stored procedures and triggers to ensure data integrity.Dimensional Modeling Methodology: Applied Ralph Kimball methodology for dimensional data modeling.