Sai Pavan Venkata Varma Email and Phone Number
• Over 8+ years of extensive experience in Database design, Data modeling, Development, Implementation, ETL, optimizing end to end data solutions, Reporting and Visualizations across diverse domains.• Adept at architecting robust and scalable data pipelines for efficient data ingestion, transformation, and analysis utilizing cutting-edge technologies like Apache Spark, Azure Databricks, and PySpark.• Highly skilled in leveraging Azure services such as Data Factory, Synapse Analytics, and Logic Apps for orchestrating and automating complex data workflows seamlessly.• Proficient in SQL, Spark SQL, and HiveQL for efficient querying and fast data retrieval from distributed storage systems like Azure Data Lake Storage, Hadoop Distributed File System, and Snowflake. • Experienced in implementing and managing large-scale data storage environments utilizing Azure Data Lake Storage, Azure Blob Storage, Hadoop Distributed File, and Databricks File Storage.• Deployed and managed Azure SQL databases, ensuring high availability, disaster recovery, and implemented performance tuning techniques for optimal database performance.• Designed and implemented comprehensive end-to-end data engineering solutions using Azure Synapse Analytics for efficient data ingestion, transformation, and loading processes.• Designed and implemented complex data workflows using Azure Logic Apps to automate data tasks, improving data quality and ensuring timely data processing.• Implemented comprehensive monitoring solutions using Azure Monitor to track performance, availability, and health of data pipelines and services for proactive maintenance.• Proficient in utilizing Azure Data Factory to orchestrate intricate data workflows, facilitating seamless data movement and transformation across diverse sources and destinations.• Demonstrated expertise in harnessing Apache Airflow to architect, schedule, and oversee intricate data workflows, ensuring flawless task execution throughout the various stages of data processing.• Proficient in designing and implementing complex Directed Acyclic Graphs (DAGs) to automate data processing tasks and ensure data integrity across the entire data pipeline.• Experienced in leveraging popular business intelligence tools like Tableau and Power BI for creating interactive data visualization and analytics dashboards for data-driven decision making.• Proficient in Python programming language, utilizing libraries such as Pandas, NumPy, and PySpark for data manipulation, analysis, and parallel processing of large datasets.
Envision Physician Services
View- Website:
- envisionphysicianservices.com
- Employees:
- 2163
-
Data EngineerEnvision Physician Services Jan 2022 - PresentUnited States• Engineered custom ETL workflows within Azure Data Factory to ingest data from diverse sources, ensuring compatibility and consistency. • Designed a HIPAA-compliant and secure data lake on Azure for ingesting patient records and clinical data from multiple hospitals and healthcare facilities.• Developed SQL-based data aggregation queries within Snowflake to generate aggregated statistics and key performance indicators (KPIs) for healthcare analytics reports, enabling stakeholders to monitor healthcare trends, patient outcomes, and operational efficiencies over time.• Developed Spark code for data masking, pseudonymization, and de-identification on Azure Databricks, ensuring patient data privacy and compliance with healthcare regulations.• Implemented Azure Data Factory pipelines for efficient Extract, Load, and Transform (ELT) processes from diverse data sources to the centralized analytics data store.• Deployed Snowflake, a cloud-based data warehouse, for serving analytics queries and dashboarding requirements, providing high performance and scalability for data analysis tasks.• Optimized SnowPipe auto-ingestion and processed data in Snowflake using SQL, stored procedures, and views, enabling efficient data transformation and querying capabilities.• Configured Snowflake security with network policies, encryption, and role-based access control, ensuring data protection and compliance with industry-standard security practices.• Integrated Azure Monitor and Log Analytics for comprehensive monitoring of data pipelines and resource usage, enabling proactive issue detection and resolution.• Automated CI/CD workflows using Azure DevOps for seamless Spark job releases and Databricks notebook deployment, streamlining the development and deployment processes.• Enabled Azure Data Lake Storage lifecycle management and backup policies for data governance, ensuring data retention and recovery capabilities in case of incidents.
-
Data EngineerGet Insured Jan 2019 - Dec 2021United States• Utilized Tableau visual analytics and best practices like Dashboard structure, view orientation, and Layout, Data Emphasis, Highlighting, Tooltips, and performance improvement of complex dashboards/reports.• Worked on Tableau bridge to schedule the data refresh. Created and managed tableau online user groups and permissions.• Involved in administration tasks such as Setting permissions, managing ownerships, and providing access to the users and adding them to the specific group.• Distributed Tableau reports using techniques like Packaged Workbooks, PDF to different user community.• Designed and developed Map Reduce jobs to process data coming in different file formats like XML.• Followed Test driven development of Agile Methodology to produce high quality software.• Designed and developed a horizontally scalable APIs using Python Flask.• Worked with cloud providers and APIs for Amazon (AWS) EC2, S3, VPC with GFS storage.• Performed tuned and optimized various complex SQL queries and worked with Data ingestion, querying, processing, and analysis of big data.• Improved efficiency by 40% in the process and automated manual reports using Tableau and other ETL tools built ETL models to enhance business processes and automate data extraction which lowered 200 man hours.• Defined, developed and implemented data models to generate meaningful insights and delivered self-service analytical data visualizations to the business users using Power BI reports.• Developed 85% custom Microsoft Power BI dashboards, visualizations, and interfaces with Microsoft SSRS to deliver meaningful and actionable insights.• Used Power BI to collaborate with different users and stakeholders to work on live data sources and responsible for performing data analytics and generating insights as per business requirements.• I was responsible for creating Power BI apps and connecting them with live data sets for real-time analysis. -
Data EngineerCvs Health Aug 2017 - Dec 2018• Architected a distributed data pipeline leveraging Apache Kafka, Apache Spark, and Python for real-time ingestion, processing, and analysis of streaming data sources.• Developed high-performance PySpark jobs on Databricks for complex ETL operations, data transformations, and feature engineering tasks across large datasets.• Designed and optimized dimensional data models within Snowflake data warehouses, enabling efficient querying and reporting for business intelligence solutions.• Implemented comprehensive data quality frameworks using Python scripts and Airflow for monitoring and ensuring data integrity throughout the data pipeline.• Collaborated closely with data science teams to operationalize machine learning models by embedding them into the data pipeline on Databricks for real-time scoring and predictions.• Designed and developed optimized data marts and cubes within Snowflake for efficient reporting and self-service analytics using Power BI.• Crafted robust Power BI data models, DAX calculations, and interactive dashboards for accurate visualization and representation of business metrics and KPIs.• Implemented row-level security within Power BI to maintain data confidentiality and ensure compliance with user access permissions.• Optimized SQL and Spark SQL queries on Databricks for efficient interactive analytics and ad-hoc data exploration, reducing query execution times. -
Sql DeveloperSanofi Apr 2015 - Mar 2017Hyderabad, Telangana, India• Designed and implemented complex SQL queries and stored procedures for data extraction, transformation, and loading (ETL) processes, ensuring efficient data movement within the organization's SQL Server databases.• Developed optimized SQL scripts to perform data validation, cleansing, and aggregation tasks, enhancing data quality and accuracy for downstream analytics.• Created SQL views and indexed views to provide simplified and efficient access to frequently used data sets, improving query performance and reducing development time for reporting purposes.• Utilized Snowflake data warehousing for storing and querying large volumes of data, ensuring scalability and flexibility in handling diverse data sources for analysis.• Implemented SnowPipe for automated data ingestion into Snowflake, streamlining the data loading process and enabling real-time analytics capabilities.• Developed Tableau data connections to Snowflake data sources, ensuring seamless integration for real-time reporting and analysis.• Actively involved in testing new/upgraded features like new Visualizations, Forecasting, Data Blending, Parallelized Dashboard, Hyperlink Objects, Color-coded tabs etc. in Tableau 8 desktop/Server.• Designed and implemented complex SQL queries, stored procedures, and ETL processes to extract, transform, and load data from multiple sources into centralized data warehouses and data marts.• Implemented PostgreSQL as a data storage solution for specific use cases, leveraging its robust features and scalability to accommodate large volumes of structured and unstructured data to business logic requirements.• Implemented SQL Server Integration Services (SSIS) packages for automating data flows and ETL processes between on-premises and cloud-based data sources.
Frequently Asked Questions about Sai Pavan Venkata Varma
What company does Sai Pavan Venkata Varma work for?
Sai Pavan Venkata Varma works for Envision Physician Services
What is Sai Pavan Venkata Varma's role at the current company?
Sai Pavan Venkata Varma's current role is Data Engineer at Envision Physician Services.
Who are Sai Pavan Venkata Varma's colleagues?
Sai Pavan Venkata Varma's colleagues are Emily Luvison, Vicki Rose, Katie Eggert, Mary Connor, John Royse, Harriet Banda, Desiree G..
Free Chrome Extension
Find emails, phones & company data instantly
Aero Online
Your AI prospecting assistant
Select data to include:
0 records × $0.02 per record
Download 750 million emails and 100 million phone numbers
Access emails and phone numbers of over 750 million business users. Instantly download verified profiles using 20+ filters, including location, job title, company, function, and industry.
Start your free trial