Source: read.acloud.guru
How I used Lambda and EFS for massively parallel compute.Category: Database, Data, github, yaml
Back in October of 2019 (in what seems like another lifetime), Nicki Stone and I presented a talk at Serverlessconf 2019 on solving BIG problems in a Serverless way. We demonstrated a serverless video encoder that would convert video files from one format to another by splitting the source file into hundreds of smaller files (let’s call them segments), converting these segments in parallel, and then merging them together to produce a new video in a new format or resolution.
Excitingly, the news of EFS support for Lambda was shared with me by folks at AWS and I was lucky enough to get beta access to it (thank you Sushant and Rebecca).
By the way, most of what you read next is a manual way of configuring EFS for Lambda.
Are you interested in EFS performance and cost from the Lambda perspective, or are you interested in Step Functions, or something else?
Excitingly, the news of EFS support for Lambda was shared with me by folks at AWS and I was lucky enough to get beta access to it (thank you Sushant and Rebecca).
By the way, most of what you read next is a manual way of configuring EFS for Lambda.
Are you interested in EFS performance and cost from the Lambda perspective, or are you interested in Step Functions, or something else?
Related Articles
Community Partners
DevOps Careers