Experienced data engineer/data analyst who has a great deal of both data engineering and analytics capabilities. I have the deep understanding of DW, Hadoop eco-system, Spark, and machine learning algorithms to be full-stack data engineer. Additionally, I have over 11 years of experiences in IT industry and completed numerous data processing and analysis projects in the fields of e-commerce, automobile, finance, and telco. I am highly dedicated to my work and never miss the deadline for the projects.Skills:- Highly proficient with MPP architecture such as Redshift, Teradata, Aster, Netezza and Hadoop.- Experienced in various data munging and development with Spark, Hive and Procedure- Strong capability of analytical programming languages such as SQL, Scala, Python, and Java- Developing batch process using Apache Airflow, Talend, Data stage and AWS lambda.- Good at software development with open source using IntelliJ and GIT/SVN- Well experienced cloud infrastructure such as Amazon Web Services- In-depth understanding of statistics and machine learning- Strong data reporting and visualization skills using Apache Superset, Tableau and Cognos
Listed skills include Sql, Teradata, Linux, Jsp, and 13 others.