Sathvik P. Email & Phone Number

Dallas, Texas, United States

Involved in gathering business requirements, logical modeling, and physical database design. I have successfully utilized Amazon EC2 infrastructure for computational tasks and leveraged S3 as a storage mechanism. Notably, my expertise lies in optimizing data pipelines for SAP data integration, contributing to enhanced efficiency and streamlined data flow within the Snowflake ecosystem. Additionally, I have harnessed GovCloud services, incorporating AWS Lambda, S3, and Amazon Redshift, for efficient data processing and analytics. I have created and executed Databricks Spark jobs with PySpark, demonstrating versatility in performing various table operations. Further, I am actively involved in developing a High-Speed BI layer on the Hadoop platform using PySpark and Python.

Dallas, Texas, United States

Leveraging proven expertise in Informatica Intelligent Cloud Services (IICS), I facilitated seamless data integration with various Azure cloud services such as Blob Storage, Data Lake Storage, SQL Database, Synapse Analytics, and other key components. My accomplishments extend to the successful implementation of data migration strategies from SAP to Snowflake. I have worked with Spark to enhance performance and optimize existing algorithms in Hadoop, utilizing Spark Context, Spark-SQL, Data Frame, RDDs, and Spark YARN. My responsibilities also encompassed managing diverse data models associated with NoSQL databases (Mongo DB, Cassandra) and relational databases (MS SQL Server, PostgreSQL, Oracle).

New Jersey, United States

Developed robust ETL pipelines and data solutions, particularly within the AWS ecosystem. Using Talend and PySpark, I successfully created ETL pipelines for migrating on-premises data sources, including Flat Files, Mainframe Files, and Databases, to AWS S3. Additionally, I embedded Python modules within these pipelines, automating the migration of data from S3 to Redshift using AWS Glue. I played a crucial role in designing and implementing Kafka clusters, configuring topics across various environments. I focused on data pipelining and integration, particularly with Snowflake data warehouses. In the requirement and design phase, I led the implementation of a Streaming Lambda Architecture, enabling real-time streaming using Spark and Kafka.

Bengaluru, Karnataka, India

I successfully configured data loads from S3 to Redshift using AWS Data Pipeline. Leveraging AWS Redshift, I executed the extraction, transformation, and loading of data from diverse sources, contributing to streamlined and efficient data processes. I developed scripts to extract data from web sources, PDFs, text files, and APIs, employing techniques such as OCR, Beautiful Soup, Scrappy, and Selenium. I have developed ETL pipelines using Spark and Hive, specializing in business-specific transformations. Additionally, I actively contribute to building data applications and automating pipelines in Spark for both bulk and incremental loads of various datasets. In the domain of Apache Spark, I have written, compiled, and executed programs in PySpark to perform ETL jobs with ingested data. Furthermore, I created HIVE Queries to process large sets of structured, semi-structured, and unstructured data, storing them in both Managed and External tables.

Hyderabad, Telangana, India

Designed, developed, and documented new architecture and development processes to transition existing ETL pipelines into Hadoop-based systems. Also, configured high availability using geographical MongoDB replica sets across multiple data centers, ensuring data reliability and accessibility. Utilized Git, GitHub, and Amazon EC2 for version control and deployment, with deployment expertise in Heroku and conducted data analysis and mathematical operations using Python libraries like NumPy and SciPy, extracting data for analysis and calculation purposes. Also designed data pipelines to capture streaming web data and RDBMS source data, enabling real-time analysis and reporting. Implemented complex calculated measures using Data Analysis Expression Language (DAX) for advanced data analysis.

Master Of Science - Ms, Computer Science

Bachelor Of Technology - Btech, Computer Science