Data Engineer
CurrentAt **Farm Credit Services of America**, I am currently working as a **Data Engineer**. In this financial domain project, I am responsible for handling data from multiple banks and financial institutions. We use **Kafka** for data streaming, and I work on creating ETL pipelines using **SQL Server**, **HBase**, and **Hive**. For programming and scripting, I use **Python**, **PySpark**, and **Scala**.Our cloud platform is **Azure**, where we store the processed data in **Azure Data Lake**. I also implement continuous integration and deployment (CI/CD) using **Jenkins**, ensuring seamless deployment and testing of our pipelines. We follow a **two-week Agile sprint** methodology to keep track of progress and ensure timely deliveries.