Santosh B. Email & Phone Number

Chicago, Illinois, United States

I am an Azure Data Engineer specializing in high-performance analytics solutions that drive data-driven decision-making. My expertise lies in leveraging Azure Databricks and Azure Event Hub to create real-time and batch data processing pipelines. I focus on building scalable ETL pipelines using Azure Data Factory, integrating diverse data sources to generate valuable insights.I have architected Azure Event Hub as a high-throughput event streaming platform, enabling businesses to manage significant data ingress. I integrate it with Azure Streaming Services, Logic Apps, and Azure Functions to automate workflows and trigger responses based on real-time events. Additionally, I utilize Power BI to create interactive visualizations that translate complex data from Azure Databricks into actionable intelligence for effective decision-making.My experience with Apache Spark enhances data transformation and processing, leveraging distributed computing for improved data quality and efficiency. I orchestrate complex data workflows using Apache Airflow, ensuring reliable ETL processes. I also incorporate Azure Synapse for advanced analytics and data warehousing, optimizing query performance and schema design.I utilize Azure HDInsight and Azure Data Lake Storage for seamless data storage and access, implementing automated cluster scaling to optimize resource utilization. My monitoring approach, using tools like Azure Monitor and Databricks Cluster Events, ensures real-time visibility and quick resolution of performance issues.Passionate about solving complex business challenges through Azure’s ecosystem, I document architecture, workflows, and best practices to foster collaboration and knowledge sharing within teams. My goal is to drive meaningful business outcomes through data, ensuring scalability and efficiency in every project.

Irving, Texas, United States

I specialize in building robust, scalable data architectures using key AWS services. My expertise includes leveraging Amazon S3 for scalable data storage, AWS Glue for automated ETL processes, and Amazon Redshift as a centralized data warehouse. I integrate Snowflake into the architecture to enhance scalability and analytics capabilities, while using Apache Airflow for real-time data ingestion and processing, ensuring timely insights.In my work, I’ve developed and optimized ETL pipelines, utilizing AWS Glue, SSIS, and PySpark scripts to handle structured and unstructured data, ensuring data quality and consistency. I’ve also modeled Amazon Redshift for efficient querying, applying best practices in schema design, distribution keys, and sort keys. AWS Glue Data Catalog is key to my approach for data discovery and lineage tracking.Additionally, I design interactive visualizations in Amazon QuickSight to provide business users with up-to-date reports, facilitating data-driven decision-making. I ensure data security with fine-grained access controls and encryption, maintaining adherence to industry standards. Monitoring and optimizing AWS performance is integral to my process, utilizing auto-scaling, query optimization, and Amazon CloudWatch for real-time alerts.Collaboration with data scientists and analysts is central to my role, delivering solutions that drive operational efficiency and empower strategic growth. Through these efforts, I help organizations achieve meaningful insights from their data.

Bengaluru, Karnataka, India

I specialize in designing and implementing scalable big data solutions using a wide range of technologies, including Informatica, Hadoop, and Apache Spark. My expertise includes creating robust data ingestion pipelines, extracting, cleaning, and preprocessing data from diverse sources such as on-premises Microsoft SQL Server databases. I leverage Informatica for data profiling to ensure data accuracy and reliability, while seamlessly integrating SSIS with Hadoop platforms for large-scale data storage and retrieval.I have developed real-time data streaming solutions using Apache Kafka and Flume, ensuring seamless data flow into the big data ecosystem. My experience also includes developing distributed data processing scripts in PySpark, utilizing advanced Spark optimization techniques like data partitioning, memory management, and shuffling to achieve optimal performance on large datasets.I orchestrate complex data workflows and ETL pipelines using Airflow and Oozie, ensuring reliable execution of data tasks. My skills in Hive and Apache Sqoop enable efficient data integration, querying, and analysis across the big data platform.I’m passionate about translating big data insights into actionable business intelligence using Tableau for data visualization. With a focus on collaboration, I work closely with stakeholders to ensure ETL processes meet business needs, while creating comprehensive documentation to support knowledge sharing and future scalability. Through these efforts, I deliver high-performance, on-premises big data solutions that drive critical decision-making.

Hyderabad, Telangana, India

As a Python intern, I focus on developing backend systems and working with data and service integrations. I’ve gained experience in building microservices using Flask and migrating legacy applications to Python 3. My work involves implementing REST APIs to support smooth data and service integrations.I also contribute to coding, testing, and debugging applications, and have developed unit tests using PyTest to ensure the reliability of the codebase. In addition, I have hands-on experience with AWS cloud services, where I’ve deployed web applications and ensured they run efficiently.I’ve worked with Jenkins for continuous integration and GIT for version control, supporting the development and deployment process. I enjoy collaborating with teams to build user interfaces and backend systems, ensuring that software solutions meet business and technical requirements. Through my internship, I’ve enhanced my skills in writing clean, maintainable code and contributing to the overall success of the projects I’m involved in.

Bachelor Of Science - Bs, Computer Science, 3.9

Bsc Applied Sciences, Computer Science, 3.8