Movatterモバイル変換


[0]ホーム

URL:


Skip to content
DEV Community
Log in Create account

DEV Community

Jordan Hansen
Jordan Hansen

Posted on • Originally published atjavascriptwebscrapingguy.com on

     

Puppeteer on Lambda! Updated and better.

Demo code here

Uploading directly to Lambda has a size limit of 50MB.

This makes it difficult for Puppeteer, which is a very large library. Uploading your code to s3 and then updating your function from there increases this size limit to (I think) 250MB!

I use 7zip and typescript and here is my scripts that I use to upload to Lambda.

"scripts": {    "zip": "tsc && 7z a -r function.zip ./dist/* node_modules/",    "sendToLambda": "npm run zip && aws s3 cp function.zip s3://chrome-aws && aws lambda update-function-code --function-name puppeteer-on-lambda --s3-bucket chrome-aws --s3-key function.zip"  },
Enter fullscreen modeExit fullscreen mode

Looking for business leads?

Using the techniques talked about here atjavascriptwebscrapingguy.com, we’ve been able to launch a way to access awesome web data. Learn more atCobalt Intelligence!

The postPuppeteer on Lambda! Updated and better. appeared first onJavascript Web Scraping Guy.

Top comments(1)

Subscribe
pic
Create template

Templates let you quickly answer FAQs or store snippets for re-use.

Dismiss
CollapseExpand
 
codingtomusic profile image
Tom Connors
Data Science and Visualization. Use data for good decisions & planning.Boston needs a network of protected bike lanes
  • Location
    Boston
  • Education
    BS Computer Science Northeastern University, MBA Babson College
  • Work
    Cloud Engineer at Connors Consulting LLC
  • Joined

This is just spam

This is useless content that makes the site useless

Are you sure you want to hide this comment? It will become hidden in your post, but will still be visible via the comment'spermalink.

For further actions, you may consider blocking this person and/orreporting abuse

Software engineer and javascript lover.I love the power of the web and getting the data from it with web scraping.
  • Location
    Eagle, ID
  • Education
    Boise State University
  • Work
    Software Engineer at Lenovo Software
  • Joined

More fromJordan Hansen

DEV Community

We're a place where coders share, stay up-to-date and grow their careers.

Log in Create account

[8]ページ先頭

©2009-2025 Movatter.jp