Sai Charan Email & Phone Number

Boston, Massachusetts, United States

In my role, I've spearheaded the engineering, design, and development efforts focusing on Query Processing and Self-Tuning functionality using Azure Synapse SQL. Additionally, I have been instrumental in establishing robust security practices by implementing Azure Key Vault for securely storing connection strings, certificates, and other sensitive details, which were seamlessly integrated into Azure Data Factory workflows through linked services configuration.Within the Hadoop and RDBMS environment, I have led the design, development, and maintenance of data integration programs, bridging traditional and non-traditional source systems to enable seamless data flow. My expertise extends to monitoring Hadoop clusters using Cloudera Manager, collaborating with Cloudera support, and implementing solutions based on their recommendations to ensure optimal cluster performance and reliability. Moreover, I have a strong background in Informatica PowerCenter, proficiently managing mappings, workflows, and transformations to orchestrate data movement across various sources, targets, and data warehousing environments.Furthermore, I have demonstrated proficiency in implementing scalable data processing solutions utilizing technologies like Kafka, Spark, and Hive, while also migrating legacy MapReduce programs to Spark transformations for enhanced efficiency and performance. I have been involved in designing and implementing dimensional data models, including star and snowflake schemas, to facilitate efficient querying and analysis. My experience extends to data visualization tools like Tableau and Power BI, where I have integrated various data sources and designed interactive dashboards to empower stakeholders with actionable insights. Additionally, I have leveraged GitHub and Jira for version control, collaboration, and project management, utilizing their advanced features to streamline development workflows and enhance productivity.

I have extensive experience in implementing AWS solutions, utilizing services such as EC2, S3, RDS, and more, to build scalable and reliable architectures. This includes setting up monitors, alarms, and notifications using AWS CloudWatch and optimizing resource usage with techniques like auto scaling and elastic load balancing. Additionally, I have leveraged Amazon DynamoDB for event-based metrics tracking and collaborated closely with architects to enhance and optimize Spark and Scala code for data mining tasks. Furthermore, I have designed and implemented NoSQL database schema migrations and worked on data warehouse solutions using PostgreSQL.In terms of data processing and analysis, I have developed various ingestion pipelines using technologies like Spark, Kafka, Kudu, and Impala, catering to both real-time and batch processing needs. I have also specialized in building data integration pipeline objects using Apache Spark, PySpark, Python, or Scala, and have expertise in dimensional data modeling, including star and snowflake schemas. My experience extends to cloud data warehousing platforms like Snowflake, where I've integrated data from multiple sources, including JSON formatted data loaded into Snowflake tables.Moreover, I possess strong visualization and analytics skills, particularly in tools like Tableau and Power BI. I've implemented advanced analytics techniques within Tableau, including spatial analysis and forecasting, to derive insights from data. Additionally, I've set up and managed data gateways in Power BI for secure access to on-premises data sources and created custom connectors to integrate external data sources for comprehensive analysis. Lastly, I have expertise in workflow automation using GitHub Actions and designing complex Jira workflows tailored to project requirements, including approval processes and notifications.

In my role, I have focused on designing and implementing robust ETL frameworks utilizing Azure Data Factory and Azure Databricks within the Microsoft Azure cloud environment. This involved creating and managing efficient data pipelines to ensure optimal architecture for data processing and analysis. Additionally, I have leveraged SSMS to proficiently administer SQL Server, Azure SQL Database, and Azure Synapse Analytics components, ensuring smooth data operations and maintenance.. Furthermore, I have utilized Python libraries such as Seaborn and Plotly for data visualization, enhancing the interpretation and presentation of insights derived from the data.Furthermore, I have played a crucial role in ensuring end-to-end data validation processes through comprehensive data lineage activities, ensuring the accuracy and reliability of data queried in Power BI. My experience extends to customizing Power BI templates and themes, maintaining brand consistency, and elevating the visual appeal of reports and dashboards. Moreover, I have utilized tools like Hive for data analysis in Hadoop clusters, alongside developing custom MySQL monitoring solutions for proactive performance management. Integration of Hadoop clusters with metadata management solutions like Apache Atlas has facilitated centralized metadata management and discovery, enhancing overall data governance.In addition to my technical expertise, I have proficiency in advanced statistical analyses using SAS procedures for hypothesis testing, regression modeling, and classification tasks. I have utilized SAS/GRAPH procedures to create custom visualizations for effective data presentation. My experience also encompasses Oracle Exadata for high-performance data warehousing solutions and hybrid cloud deployments. Additionally, I have promoted collaboration and reproducibility of analyses across teams through the implementation of version control for Jupyter Notebooks using Git and GitHub.

In my professional journey, I've honed my expertise in AWS cloud services, particularly EC2, where I adeptly configured servers for auto scaling and elastic load balancing to ensure optimal performance. Leveraging AWS EMR with Spark, I executed batch processing operations on diverse Big Data sources, enhancing efficiency and scalability. My proficiency extends to developing cloud-hosted microservices solutions using AWS Lambda, API Gateway, S3, SQS, SNS, and CloudWatch, facilitating streamlined and robust architectures.With a keen focus on data management, I've adeptly worked with structured and unstructured data sources, employing Python for efficient ETL processes. Leveraging advanced libraries like SciPy and Stats Models, I conducted thorough statistical analyses and hypothesis testing. Additionally, I've demonstrated proficiency in SQL-based data modeling for reporting and analytics, implementing data transformation processes and ETL pipelines within Hadoop environments using Apache Pig and Sqoop.Furthermore, my experience encompasses integrating BI tools such as Power BI with Microsoft products for enhanced data visualization and collaboration. I've developed SAS programs and macros for automating data analysis tasks and generating customized reports, while also leveraging SAS Data Management solutions for data profiling and enrichment. Moreover, I've played a pivotal role in implementing security measures and automation scripts for MySQL database maintenance tasks, alongside integrating QlikView with ERP and CRM platforms for comprehensive data analysis. Additionally, I've seamlessly integrated with Oracle Cloud Infrastructure (OCI) services for deploying and managing Oracle Database instances in cloud environments, showcasing a versatile skill set across various data management and cloud technologies.