Senior Big Data Engineer
Current*Implementing applications, debugging and integrating code, developing automated unit tests, performing code reviews, and assisting with technical specification documentation and review*Being involved in deploying the developed modules to our cloud environment(s) and addressing any performance and scale adjustments post deployment*Working with data scientists to understand the models and implementing them in Spark, addressing any platform and database needs.*Developed a python script to hit REST API’s and extract data to AWS S3*Worked on Ingesting data by going through cleansing and transformations and leveraging AWS Lambda, AWS Glue and StepFunctions