Data Engineering
India
● Applied Waterfall methodology to effectively manage and deliver data engineering projects on schedule and within budget, ensuring client satisfaction and alignment with business goals.● Leveraged Hive, Apache Spark, and Pig to design and implement scalable data processing pipelines, achieving a 50% reduction in processing time and enhancing data throughput by 40% for analytics and reporting.● Utilized Talend, Apache Airflow, and Informatica to automate ETL workflows, minimizing manual intervention and improving data accuracy and reliability across systems.● Administered AWS cloud infrastructure, optimizing services like S3, EC2, and RDS to achieve cost reductions; deployed data warehousing solutions on Snowflake, improving query performance and enabling real-time analytics.● Employed SciPy, Scikit-learn, Seaborn, and TensorFlow to develop machine learning models, improving predictive accuracy and providing actionable insights to stakeholders, thereby enhancing decision-making processes.● Developed interactive dashboards and reports using Power BI and SSRS, enabling stakeholders to visualize and interpret complex data trends, resulting in a 20% increase in data-driven decision-making across departments.
