Azure Data Engineer/Data Scientist
San Jose, Ca, Us
• Build visualizations and demonstrate the results of the model to the stakeholders and leadership team• Adaptability and propensity to learn new tools and programs, as well as to provide estimations, planning, design solutions, development, testing, and deployment activities.• Must be conversant with agile methodologies and tools and have a track record of delivering products in a production environment.• Created Linked Services for multiple source system (i.e.: Azure SQL Server, ADLS, BLOB, Rest API).• Worked on copy activities and implemented the copy behavior’s such as flatten hierarchy, preserve hierarchy and Merge hierarchy;• Exposure on Azure Data Factory activities such as Lookups, Stored procedures, if condition, for each, Set Variable, Append Variable, Get Metadata, Filter and wait.• Created Pipeline’s to extract data from on premises source systems to azure cloud data lake storage; Extensively worked on copy activities and implemented the copy behavior’s such as flatten hierarchy, preserve hierarchy and Merge hierarchy;• Configured the logic apps to handle email notification to the end users and key shareholders with the help of web services activity; create dynamic pipeline to handle multiple source extracting to multiple targets; extensively used azure key vaults to configure the connections in linked services.• Configured and implemented the Azure Data Factory Triggers and scheduled the Pipelines; monitored the scheduled Azure Data Factory pipelines and configured the alerts to get notification of failure pipelines.• Developed and implemented predictive models using machine learning algorithms such as linear regression, classification, Random Forests, K-means clustering, XG Boost and regularization for data analysis.• Application of various machine learning algorithms and statistical modeling like decision trees, text analytics, supervised and unsupervised, regression models