Varshitha V Email & Phone Number

Jefferson City, Missouri, United States

I have a strong background in creating and refining ETL procedures, and I've worked with AWS Glue, S3, and Redshift extensively to move campaign data from a variety of sources with ease. Creating data pipelines, obtaining data from AWS S3, converting it, and importing it into AWS Redshift are all areas of my experience. Furthermore, I've skillfully integrated clickstream data from AWS Kinesis streams, using AWS S3 to store the combined outcomes before completing the load to AWS Redshift.My ability to leverage technologies like Informatica Power Center for ETL operations has allowed me to load, extract, and transform data from flat files and Oracle among other sources into Netezza Data Warehouse. Using PySpark, I have created extensive frameworks for data intake. To preserve data integrity in HIVE tables, I have carried out data aggregation, de-duplication, and cleansing. Additionally, my expertise in implementing Hadoop systems and managing NoSQL databases has been critical in adapting to changing business needs and data architectures, all the while guaranteeing effective data storage and retrieval using Kafka log compaction and retention guidelines.I have a wealth of experience integrating strong security features like role-based access control and data encryption with cutting-edge data management tools like Time Travel, Zero-Copy Cloning, and Data Sharing within Snowflake. I have experience with Power BI and Tableau for data visualization and analysis. I have planned server capacity, implemented row-level security, and made sure that organizational standards were followed. Throughout my career, I have continuously enhanced code quality and consistency by automating repetitive tasks with Git hooks and scripts, reflecting my commitment to maintaining high standards in all projects.

St Louis, Missouri, United States

I have successfully implemented and optimized CI/CD pipelines for Azure Data Factory configurations using Azure DevOps. My expertise extends to automating Azure Data Lake management tasks via Azure CLI and creating event-driven data integration workflows using Azure Data Factory and Azure Event Grid for real-time processing. Additionally, I have leveraged Informatica Power Center to develop mappings, reusable objects, and transformations, utilizing tools like Source Analyzer, Warehouse Designer, and Transformation Developer.My proficiency in designing and developing robust ETL pipelines using Python and Apache Airflow has enabled me to streamline data extraction, transformation, and loading processes. I have extensive experience working with Hadoop ecosystem components, including HDFS, Map Reduce, and Pig, for batch processing of structured and unstructured data. Furthermore, I have designed and optimized Spark applications using Spark SQL in Databricks and implemented PySpark applications for data validation, reconciliation, and anomaly detection, ensuring efficient data processing and insights into customer usage patterns.I have developed and optimized data pipelines in Snowflake using Snow SQL and Snow Pipe, implementing data masking and obfuscation techniques to ensure privacy compliance. My analytical skills are further demonstrated through creating calculated columns, measures, and hierarchies in Power BI Desktop and designing paginated reports using Power BI Report Builder. Additionally, I have evaluated and implemented Tableau features to enhance user experience and analytical capabilities, and ensured high availability and reliability of dashboards through performance optimization strategies. My expertise is rounded out by implementing Git branching strategies tailored to project requirements, showcasing my ability to manage and optimize complex data environments.

Gurgaon Rural, Haryana, India

With extensive experience in AWS, I have adeptly executed SQL queries on AWS Glue databases, built robust data pipelines using PySpark on AWS EMR, and ensured seamless data integration into AWS Redshift. My expertise extends to designing monitoring solutions with AWS CloudWatch and AWS IAM, alongside creating dynamic and flexible ETL jobs in Informatica through parameterization and variable usage. Additionally, I have demonstrated proficiency in data transformation and cleaning using Python's Pandas library, ensuring high data quality and reliability, while also implementing automated testing frameworks like PyTest and unit test for maintaining codebase integrity.My technical acumen includes leveraging Spark and PySpark for enhancing performance and optimizing existing Hadoop algorithms, as well as handling ETL processes from multiple sources such as Kafka, NIFI, and DB2 using Hadoop Spark. I have implemented Kafka Connect connectors to facilitate seamless integration with various systems and databases. Moreover, I have excelled in creating efficient indexes for SQL stored procedures and developing automated testing frameworks for PySpark applications to uphold data quality standards.In the realm of business intelligence, I have proficiently utilized MS Power BI and Excel to format data into professional, understandable reports and dashboards tailored to diverse audiences. My experience also encompasses designing interactive Power BI visualizations, crafting complex Tableau data extracts, and automating tasks via Tableau APIs to boost operational efficiency. Furthermore, my commitment to meticulous version control and release management using Git has ensured clear version histories and streamlined release planning.

Mumbai, Maharashtra, India

I have successfully designed and implemented data migration strategies from on-premises databases to Azure, leveraging Azure Database Migration Service to ensure smooth transitions. My experience extends to developing Apache Spark jobs in Azure Synapse Analytics Spark Pools for big data processing and utilizing Azure Database elastic pools to efficiently manage multiple databases. My expertise in Azure also includes query performance tuning and optimization, implementing data masking techniques, and integrating Informatica with various data sources such as Oracle, SQL Server, and cloud platforms like Azure.My technical skills are highlighted by my proficiency in Python, where I have implemented data processing algorithms to cleanse, validate, and aggregate large datasets using libraries such as Pandas and NumPy. I have extensive experience in advanced SQL coding, developing complex stored procedures, functions, CTEs, triggers, views, and dynamic SQL for interactive reports. My work also includes analyzing Hadoop clusters and utilizing big data tools like Hive, Spark, Sqoop, and Pig Latin for data manipulations. Additionally, I have developed batch and streaming pipelines using Spark and Kafka, as well as real-time data ingestion applications with Flume and Kafka.In the realm of business intelligence and reporting, I have developed and migrated SSRS ad-hoc reports to Power BI reports, creating action filters, parameters, and calculated sets for dynamic dashboards and worksheets. My expertise in Tableau includes designing complex data architectures, performing data profiling and quality assessments, and creating data source connections, joins, and calculations to support analytical requirements. I am proficient in developing Linked reports for live data and have a keen eye for identifying anomalies and discrepancies to ensure data accuracy and reliability.