Joined 10Alytics as a Data Engineer during a pivotal phase of growth, responsible for optimizing data processes to enable data-driven decisions in a client project.Spearheaded a critical data integration and transformation initiative by implementing Data Pipelines, reducing data processing time by 25%.Successfully migrated on premise Data Distribution to Azure Cloud Distribution and Hive Data Warehouse using PySpark in less than 1 week, reducing operational costs by 30%.Reduced redundant activities of 3 departments by building Data Warehouse, undertaking Data Modeling and Data Ingestion activities.Implemented data quality checks, resulting in a 15% improvement in data accuracy.Conducted performance tuning on SQL queries, optimizing data retrieval by 20%.

As a Cloud Data Engineer at IMO-CHINA Trade and Investment Centre in the Logistics Department, I focused on optimizing data processes for streamlined cargo and logistics operations, enhancing efficiency and decision-making.Facilitated in POCs for Data Migration to Azure, delivering 100% efficiency.Achieved 100% consistency in a team of 4 members, towards driving POCs on Data Workflow in Azure Data Factory.Strengthened POCs to set up DevOps environment using Jira, Azure code deploy on Databricks and ADLS Gen2 environments.Achieved proficiency in Azure Data Factory, Databricks, ADLS Gen2, Delta Lake and other Azure services.Built end-to-end multi-cloud data pipelines for diverse data sources, resulting in the ingestion of 1TB of data daily. Reduced cost by 100-man hours through Matillion ETL for Snowflake for performing ETL operations and building data pipelines, saving 100-man hours.

As a Big Data Developer at Afanik Global Revenue Solutions, I optimize data processes to enhance revenue collection efficiency and inform government decision-making.Mastered, with 100% consistency, Hive queries by creating and querying Hive tables to retrieve useful analytical information.Initiated use of Sqoop to import large data on 10 machines from traditional RDBMS to HDFS.Utilized Python and PySpark to process and transform raw data, enabling faster insights for business analysts.Pioneered in Data Crunching, Data Ingestion, and Data Transformation activities.