Big Data Engineer
Current• Data Lake and ETL-framework development and administration using Python, Impala, PostgreSQL, Kafka, Docker, Jenkins, Kubernetes• Apache Airflow DAGs and operators development• DBT SparkSQL models development and optimization for large volume data• API recommendation service support and development using Python, FastAPI, SycllaDB, Kafka, Docker, Jenkins, AWS• Spark Streaming Data Ingestion implementation using Scala, Spark Streaming and Amazon S3