Darshan Galoliya Email & Phone Number

Bengaluru, Ka, In

Lead Software Engineer for Credit Risk Decision Application• Led a team managing a real-time database for a credit risk application, ensuring high availability and data accuracy.• Designed AWS infrastructure to support diverse data flows, aligning technical operations with business objectives.• Created over 200 ETL pipelines using AWS Glue and EC2, integrating data from multiple sources to enhance business insights.• Improved the automation and security of JSON data processing for APIs from providers like Plaid and Teller, enhancing data structure and integrity in platforms like Bubble and AWS S3.• Optimized asynchronous database connections in PostgreSQL to accommodate dynamic data dimensions, supporting adaptive business reporting.• Introduced template-based AWS Glue jobs to reduce manual effort and maximize operational efficiency.• Developed and implemented CI/CD pipelines using AWS CodeCommit, CodeBuild, and CodePipeline, enhancing deployment reliability and efficiency.• Configured real-time notifications through AWS CloudWatch, EventBridge, Lambda, and SNS, enabling timely system updates via Email and Slack.• Deployed Django and various APIs to improve user access to a unified data platform.Strategic Data Solutions for Real Estate Analytics• Engineered a comprehensive data lake to support property price prediction models, establishing a central repository for strategic analysis.• Authored secure scripts for data input handling on AWS Glue, ensuring robust data protection.• Managed data table updates with scheduled Lambda cron jobs, improving data reliability.• Utilized web scraping techniques with Beautiful Soup and Selenium to capture crucial public data, expanding the data pool.• Developed ETL templates for various data formats, streamlining workflows and reducing execution time.• Distributed ETL workloads across AWS Lambda and Step Functions, significantly reducing pipeline runtime.

Bangalore Urban, Karnataka, India

Data Engineering for a Non-Profit Organization in US• Implemented AWS Step Functions to orchestrate Lambda functions, initiating and managing scripts from an EC2 instance.• Engineered a robust data pipeline, transferring temporary and intermediate files from Python to S3, and leveraging Redshift for secure data hosting and advanced querying.Full Stack Developer for a Dashboard wire-framing tool• Designed and developed back-end systems using microservice architecture with Django and Flask.• Integrated third-party tools such as Stripe Payment Gateway, Klaviyo, and canny.io to enhancefunctionality and user experience.• Implemented WebSocket functionality for real-time auto-save features.• Leveraged AWS services for optimized product performance and seamless deployment

Ahmedabad, Gujarat, India

Ahmedabad, Gujarat, India