Data Warehouse Architect (Solution Architect)
CurrentDeveloped and maintained Databricks Python\Pyspark based etl and data management cloud solutions using Azure services such as ADF, Logic Apps, and Azure SQL ServerDeveloped and maintained Databricks Python\Pyspark based analytics and data management solutions using AWS services such as EC2, S3, Athena, and DynamoDBMigrated legacy pipelines and applications from on-premises servers to cloud-based infrastructure on Azure platformManaged databases in the cloud (e.g., Azure SQL Database) Collaborated with cross-functional teams to gather requirements, analyze business needs, and develop technical solutionsCollaborated with security teams to ensure compliance with industry standards and best practices for cloud securityEvaluated existing systems identifying areas for improvement or optimization to enhance overall system performanceWorked closely with project managers to define project scope, deliverables, timelines, and resource allocationImplemented CI/CD pipelines for continuous integration and delivery of etl solutionsParticipated in agile development methodologies, ie daily stand-ups, sprint planning, and retrospective meetingsDeveloped automated test suites using Selenium for testing purposesIntegrated third-party APIs into cloud applications to enhance functionalityPerformed troubleshooting and debugging of issues in production environments to ensure smooth operation of cloud applicationsConducted code reviews and provided constructive feedback to team members on best practices for developing scalable maintainable code in the cloudResearched and evaluated new cloud technologies and services to recommend improvements or cost-saving measuresMentored developers on cloud development best practices providing guidance on complex technical issuesStayed up-to-date with emerging technologies in cloud computing and made recommendations for their adoption based on end user requirements