Saroj Kumar Sahoo Email and Phone Number

• Architected, Designed and implemented scalable, secure cloud architecture based on Amazon Web Services. Leveraged AWS cloud services such as Glue, EMR ,Redshift,Lambda to build secure, highly scalable and flexible systems that handled expected and unexpected load bursts and can quickly evolve during development iterations.• Designed and developed a highly scalable data model and data warehouse using Redshift and snowflake resulting in a 40% improvement in data processing speed and a 25% reduction in storage costs.• Collaborated with stakeholders to understand their data requirements and developed customized data solutions, leading to a 30% increase in data accuracy and a 20% improvement in data accessibility.• Implemented data security policies and procedures, ensuring compliance with industry regulations and achieving a 100% data security audit score.• Developed generic Spark frameworks to assist different data science teams on onboarding different datasets from various sources resulting in 50% improvement in onboarding effort.• Leveraged AWS S3, Lambda and Glue to build serverless event driven data pipelines.• Developed end to end streaming data pipelines using Kinesis stream, S3 and Athena. • Developed python code for different tasks, dependencies, SLA watcher and time sensor for each job for workflow management and automation using Airflow tool.• Developed and maintained ETL pipelines using Apache Airflow to orchestrate complex data workflows, including extraction, transformation, and loading processes.• Deployed data pipelines with CICD process using Code pipelines, CDK. Environment: AWS , Snowflake, Redshift, GLue, EMR, ,Python, PySpark, Airflow, CDK, Tableau, QuickSight

• Lead architecture design and automate end to end data / ETL pipelines using AWS, Google Big query and Python to migrate data from GCP/MsSQL to Snowflake• Optimized ETL processes for loading data into Snowflake, resulting in a 50% reduction in data loading time and a 15% improvement in overall data quality.• Created Datawarehouse and tables for the Marketing use cases like Leads , opportunity to support data model in Snowflake improving the query efficiency by 70%.• Designed and automated existing sales and inventory processes using SQL reducing the reporting time. • Utilized Python to get data from API and performing exploratory data analysis .• Used distributed computing tools such as Google Big Query, Snowflake, Redshift for structured processing of data, data querying and integration.• Integrated Airflow with cloud services such as AWS S3, Redshift, and EMR to facilitate seamless data transfer and processing in a distributed environment.• Developed and maintained ETL pipelines using Apache Airflow to orchestrate complex data workflows, including extraction, transformation, and loading processes.• Worked on importing data from various sources and performed transformations using HIVE.• Ingested the customer data using Flume and analyzed the customer behavior by performing click stream analysis.• Collected and aggregated large amount of log data using Flume and stored the data in HDFS for further analysis.Environment: AWS,GCP, Snowflake, Redshift, Glue, Databricks, BigQuery, Snowflake, DBT, Python, Tableau, Airflow

• Design, implement and support an analytical data infrastructure on traditional data warhouse and AWS• Created data warehouse and data marts to build client specific reports and dashboards• Developed ETL workflows on AWS resources using EC2, S3,RDS, Redshift and so on.• Interface with other technology teams to extract, transform, and load data from a wide variety of data sources using SQL and AWS big data technologies.• Worked on Poc on multiple AWS technologies which solves clients usecases.

• Develop and maintain data warehouse / data Mart to enable client to effectively acquire, integrate and distribute information regarding its customers, activities, products and so on. • Designed and developed mappings, mapplets, sessions and workflows to load data from source systems to target systems• Created target database using informatica powercenter. Extracted data from different sources like flat files, oracle and other databases.• Built reusable components including mapplets and sessions.• Created and scheduled workflows using control -M for daily processing of data. • Worked extensively on Informatica powercenter, oracle plsql and bigdata technologies for the serving the client’s DW needs.• Worked with Big data teams to access feasibilty to move the current Datawarehouse to Hadoop.• Worked with advanced file formats on big data technolgy for performance optimization

Informatica developer,Tech lead, Database developer,Oracle,Netezza