#Let's Data

#Let’s Data simplifies data pipelines and eliminates infrastructure pains. Our promise: "Focus on the data, we'll manage the infrastructure". We've perfected our infrastructure code for AWS Services and built all the reliability, fault tolerance and diagnostics needed for a high-quality compute pipeline. The #Let’s Data Simplification has the following benefits: • Faster development times (42 dev weeks reduced to 8 dev weeks - Web Crawl Archive Case Study) • Reduced costs (ROI calculations for a small sized data team suggests ~ $3.72M savings in 1 year on AWS spend of ~ $100K per month, primarily from headcount reduction. Switching costs have been estimated as $850K with payback time of ~2.74 months) • Simplified development and reduced system complexity (See the architecture diagram for The #Let's Data Simplification) • Standardized development and operations (Full featured CLI, Console, logging, errors, metrics and task management builtin) • High Performance & Elastic Scale (In a web crawler case study, #Let’s Data processed 219K files (~477 TB) from S3 using Lambda in 48 hours at a nominal cost of $ 5 per TB-Hour!) • Zero cost version updates (AWS SDK upgrades, #Let's Data version upgrades etc.) #Let's Data defines simple interfaces for developers to transform records - #Let's Data will read from AWS, write to AWS and takes care of the performance, errors, diagnostics and everything in-between. #Let’s Data Minimum Viable Product (MVP) currently support: • S3 • DynamoDB • SQS • Kinesis • Lambda In a web crawler case study, #Let’s Data processed 219K files (~477 TB) from S3 using Lambda in 48 hours at a nominal cost of $ 5 per TB-Hour!