Shiva Krishna Email & Phone Number

Fort Worth, Texas, United States

In my role as a Senior Data Engineer & Python Developer at Pennymac, I spearheaded the development and management of advanced data solutions that optimized operational efficiency and data-driven decision-making. I crafted and maintained Python scripts with libraries like Pandas and Numpy to enhance data processing capabilities. I was instrumental in designing and managing PostgreSQL databases, developing robust FastAPIs for real-time data services, and orchestrating complex data workflows using Apache Airflow. I also led the integration and management of AWS technologies, including Redshift, Kinesis, and EMR, to support extensive data warehousing, streaming, and processing tasks. My efforts included deploying machine learning models with AWS SageMaker and implementing infrastructure automation with AWS CloudFormation, significantly improving scalability and reliability across the organization’s data systems. Additionally, I managed AWS Identity and Access Management (IAM) to ensure secure access and adherence to best practices for data security and compliance.

Nashville, Tennessee, United States

As a Senior Data Engineer & Python Developer on this project, I led the development and optimization of scalable big data solutions using PySpark and Oracle, enhancing data analytics and machine learning capabilities to efficiently process vast datasets. I architected robust FastAPIs to support high-load applications and managed Azure-based data services, including Synapse Analytics, HDInsight, and Event Hub, to enable deep analytics and real-time data ingestion. My role also involved designing and maintaining CI/CD workflows with GitHub Actions, orchestrating data pipelines using Apache Airflow and Azure Data Factory, and ensuring high availability and security with Azure's cloud infrastructure solutions.

Pennsylvania, United States

As a Senior Data Engineer & Python Developer at Radian Group, I played a pivotal role in developing and maintaining scalable data warehousing solutions using BigQuery, optimizing query execution for actionable insights. I managed and optimized Cloud SQL instances for high availability and security, while orchestrating automated data processing pipelines with Cloud Dataflow. Additionally, I administered various Google Cloud services, implemented machine learning models with Google AI Platform, and maintained data orchestration workflows using Apache Airflow. My contributions streamlined data processing, enhanced decision-making, and ensured compliance within a dynamic cloud environment.

Mooresville, North Carolina, United States

As a Senior Data Engineer & Python Developer, I supported the development and implementation of customized data solutions tailored to specific client needs. I assisted in engineering Python-based analytics using libraries such as Pandas and Scikit-Learn, and helped manage SQL Server and AWS RDS databases to ensure optimal performance and scalability. My responsibilities included aiding in the creation of seamless data integration pathways using PyODBC, and contributing to the development of secure, robust APIs with Flask. Additionally, I was involved in orchestrating and managing containerized applications using Docker, and supporting CI/CD processes with Bitbucket.