Skip to content

🟩 🌐 Netlify Lambda function to scrape metadata from a target URL.

License

Notifications You must be signed in to change notification settings

toddbirchard/lambda-metadata-scraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

50 Commits
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 

Repository files navigation

Lambda Metadata Scraper

Go Goquery AWS Lambda GitHub Last Commit GitHub Issues GitHub Stars GitHub Forks

Lambda function which returns basic metadata for a single URL provided as a ?url querystring parameter. Intended to be deployed as an endpoint served with Netlify functions.

Example Usage

  • Request Type: GET
  • Endpoint: https://hackersandslackers.com/.netlify/functions/scrape
  • Parameter: ?url=[TARGET_URL]
$ curl https://hackersandslackers.com/.netlify/functions/scrape?url=https://toddbirchard.com \
   -H "Content-Type: application/json"

Response:

{
   "Title": "Todd Birchard: Engineering, Product, Technology.",
   "Image": "https://storage.googleapis.com/toddbirchard-cdn/2019/08/cover.jpeg",
   "Description": "Giant reptile giving technology a good name. Occasional tangents of mass destruction. Made in Silicon Alley.",
   "Favicon": "/icons/icon-48x48.png"
}

About

🟩 🌐 Netlify Lambda function to scrape metadata from a target URL.

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages