crawling with node (requester)
i have written a lot of scripts that crawl things, and i have had to do a lot of weird things because most network scripts lack the odd features i need.
requester is a little network lib where i have shoved all of the features that i need.
repo: https://github.com/icodeforlove/node-requester
example of a get request
requester.get(/* URL */, function (body) {
console.log(body)
});
example of a multipart post
requester.multipart(/* URL */, {data: {'@filename': /* FILE PATH */}}, function (body) {
console.log(body)
});
Written by Chad Scira
Related protips
Have a fresh tip? Share with Coderwall community!
Post
Post a tip
Best
#Nodejs
Authors
Related Tags
#nodejs
Sponsored by #native_company# — Learn More
#native_title#
#native_desc#