I have extensive experience as a Data Engineer, specializing in designing and implementing data solutions on the Azure Cloud platform. My expertise includes optimizing data pipelines, managing data workflows, and leveraging Azure services to drive business insights and innovation. In this project as Azure engineer I created pipelines for extracting, loading and transforming data, also created dashboards in Azure Power BI to analyze data.Main stack:-Azure Blob storage-Azure Data factory -Azure Functions -Azure Power BI

Main work stack: Amazon Web Services, PySpark. Creating data migration task by using DMS and processing data with PySpark/Glue. Working with RDBMS - AWS RedShift. Working with NoSQL databases - MongoDB. Creating ELT pipelines by using AWS Glue. Creating and processing Delta Lake by using DeltaLake/PySpark/S3. Creating and processing data in RDBMS AWS RedShift.Working with API by using FastAPI, AWS API Gateway, DRF. Most frequently used tools: AWS DMS, AWS StepFunction, AWS Glue/PySpark, Pandas, NumPy, AWS RedShift, Apache Airflow, Apache Arrow, Linux.

Creating ETL processes on AWS Glue(Spark). Transferring data from local bases to Delta lake. Creating scripts of data transferring and parsing by using Python. Creating DAG's on Airflow orchestrator(MWAA).Solving problems on Python(Spark), writing scripts on SQL.Main project was creating DWH system for Marketplace. Participated in raising and setting up clickhouse, also developed an incremental model using DBT. Main stack: AWS DMS, Airflow, DBT, Clickhouse, QlikSense.

Working with SQL databases: Oracle, Postgres. Processing data with PentahoDI. Creating ETL pipelines and job with PentahoDI. Solving problems of raw data. Creating schemas: Star, DVault Schemas.

Creating functions of Small Logistics app. Improvement design of app. Stack: Java, RxJava, Dagger.