Trần Nam Email & Phone Number

Hanoi, Vn

Hanoi, Vn

Hanoi, Hanoi, Vietnam

Hà Nội

Ha Noi, Viet Nam

Responsibilities:* Deployment:- Build, configure, test and deploy analytics infrastructure on production using Docker Compose: Trino (Secured), Citus, DBT, Airflow, Superset,...- Deploy Gitlab CI/CD- Wordpress and Nginx (reverse proxy, HTTPS)- Deploy and manage Citus For Distributed Postgres (10 milion rows/second speed for analytic queries) * Optimization:- Migrate data from Oracle, SQL Server to Postgres using the combination of Trino, Airflow, DBT- Compress data using columnar compression, distributed postgres data (3 nodes)- Rebuild dbt-trino package to be more productive using Jinja2 (Create user-defined macros, fix incremental strategy in PSQL connector, split query to support Trino reading indexes from PSQL)- Use Python + Jinja2 + DBT-Trino + Airflow to create dynamic airflow dags/task and support full transform or incremental tranform with large amount of data in a short time. (Easy to keep track ETL jobs)- Create column indexes PostgresSQL, SQLServer to enhance query performance * Programming:- Write modules to extract JSON data that supports DS/DA to build machine learning pipeline and other data tasks- Write/Debug/Maintain Airflow Dags/Tasks and desgin their workflow using Python- Transform, and analyze data using SQLServer, PostgresSQL, TrinoSQL to create dashboards on Superset- Write DBT code that can fully/incrementally transform and load data in a database or even a cross-platform database- Write system health-check script using Python (Codon compiler)

Ha Noi

Responsibilities:- Coordinating the delivery of orders- Creating metrics to track and enhance performance- Building weekly delivery performance report using MS Power BI (connect with multiple sources) - Cleaning data, calculating Operation KPI using Power ExcelThe experience gained:- Persistence, Communication skills, Independent working skills, problem-solving skills, data-driven skills