Big Data EngineerDesigner,Development ,Test and Support of Big Data Applications A collaborative engineering professional with 17 years of substantial experience designing, development, executing and supporting applications for complex business problems involving large scale data warehousing, near to real-time analytics and reporting solutions. Known for using the right tools when and where they make sense and creating an intuitive architecture that helps organizations effectively analyze and process structured and unstructured internal.CompetencyData Lake/DW/DM: Proven history of building data processing systems and serving as an expert while working with a variety of database technologies,structure and unstructured files,flat files designing and optimizing while loading into data lake/data warehouses/data marts.Architecturing data models of highly scalable, distributed systems using different tools,designing and optimizing downstreams.Database and Tools : Oracle,MS SQL Server, Teradata, DB2, Netezza, HDFS, NoSQL,Mongodb,Cassandra.
Data Analysis : Consulted with business partners and data architects and made recommendations to improve the effectiveness of Big Data systems for descriptive analytics systems. Tools : SQL,Toad,Hue,Power BI,Tableau,Jupyter Notebook,Python, Pyspark
Data Transformation : Experience hands-on designing high level & low design documents,ETL Mapping documents, design data flow diagram and process improvements for the applications by implementing and optimizing data transformation processes in the Hadoop and Informatica ecosystems.Tools :HDFS,Apache Hive Kudu, Impala,Informatica (Power Center, BDM Developer, Power Exchange, IDQ), Datastage, Alteryx, Talend, HQL,Sqoop,Apache Nifi, Cloudera.
Data Collection: Capable of extracting the data from existing different databases/files
Tools : Collibra, Data Mapping toolData Model : Designed the Logical and physical data mart models to organize the elements of data and standardize how they relate to other entities.
Tools : Erwin & Power Designer.
Business Intelligence : Designed and Developed reports for data analysis and DataVisualization for different strategies, data analysis,reports and dashboard development. Tools : Power BI,Cognos (certified), Alteryx ,Tableau.
Exposure to Cloud env’s (aws & microsoft azure) and hands on NoSQL databasesPast experience leading as Team Lead and training/mentoring less experienced personnel
