As a seasoned Data Engineer with 5.5 years of experience, I specialize in designing, building, and maintaining scalable data infrastructures, particularly within AWS cloud environments. My expertise spans a wide range of AWS services, including AWS Glue, S3, EC2, and RDS, as well as advanced data processing and streaming technologies like Apache Kafka, Spark, Spark Streaming, and AWS Kinesis.I'm proficient in ETL development and data integration using tools such as AWS Glue, Apache NiFi, and Talend, ensuring efficient and reliable data workflows. My experience with big data ecosystems, including Hadoop, Hive, HBase, and Impala, has equipped me to handle complex data analysis and derive actionable insights.I have a deep understanding of data warehousing solutions like Amazon Redshift and Snowflake, optimizing both data storage and query performance. My Python programming skills, combined with a strong foundation in libraries like NumPy, pandas, SciPy, and Scikit-learn, enable me to perform advanced data manipulation and analysis. I've also implemented machine learning pipelines using PySpark, MLlib, and Scikit-learn to support predictive modeling and data-driven decision-making.In addition, I'm skilled in data visualization and business intelligence tools such as Tableau, Power BI, and Seaborn, transforming complex datasets into meaningful insights. I have a strong background in database management, working with SQL and NoSQL databases like MySQL, Cassandra, and Oracle, ensuring data integrity and system performance.My work extends to data lake architecture, where I design and implement solutions on AWS, centralizing and democratizing data access. I prioritize data governance and compliance, implementing robust data quality and lineage practices to uphold high standards.I've also gained experience with Apache Airflow for workflow management, RESTful API integration, and development, along with source control and CI/CD tools like Git, Jenkins, and Ansible. This expertise supports agile practices and efficient continuous integration and delivery pipelines.Throughout my career, I've collaborated closely with cross-functional teams, providing essential data engineering support to data analysts, scientists, and business stakeholders, contributing to project success. I'm committed to continuous learning, staying updated with the latest technologies and best practices in data engineering to deliver innovative and industry-leading solutions.
Listed skills include Leadership, Microsoft Office, Management, Microsoft Word, and 32 others.
