Data Engineer
Current- Provided GIS expertise (ArcGIS, QGIS). - Played a key role in integrating ArcGIS tools, including ArcGIS Python API, ArcGIS Server, ArcGIS Enterprise, and ArcGIS Online (AGOL), enhancing geospatial capabilities. - Engineered robust ETL pipelines using Airflow, Python, SQL, PySpark, Dagster, and dbt, ensuring efficient and seamless data processing. - Established a scalable data lake infrastructure on AWS, incorporating services like AWS RDS, AWS Glue Catalog, S3, ECS, EMR, optimising data storage and analysis. - Developed backend for web applications/RESP APIs.