Data Engineer
Current- Optimize query performance(query cost) by changing query logic, using staging table or CTE, using indexes, select only required data, etc- Optimize existing data pipeline in Talend by simplifying components- Convert existing single-process flow from API into a batch process flow to improve data pipeline job execution time- Develop ETL data pipeline job- Data modelling for product enhancement- Migrate ETL data pipeline from Talend job to NiFi flowTools: Talend, SQL,… Show more - Optimize query performance(query cost) by changing query logic, using staging table or CTE, using indexes, select only required data, etc- Optimize existing data pipeline in Talend by simplifying components- Convert existing single-process flow from API into a batch process flow to improve data pipeline job execution time- Develop ETL data pipeline job- Data modelling for product enhancement- Migrate ETL data pipeline from Talend job to NiFi flowTools: Talend, SQL, PostgreSQL, NiFi, Java, Python, Linux Show less