Last Updated: December 26, 2018
·
641
· icodeforlove

crawling with node (requester)

i have written a lot of scripts that crawl things, and i have had to do a lot of weird things because most network scripts lack the odd features i need.

requester is a little network lib where i have shoved all of the features that i need.

repo: https://github.com/icodeforlove/node-requester

example of a get request

requester.get(/* URL */, function (body) {
    console.log(body)
});

example of a multipart post

requester.multipart(/* URL */, {data: {'@filename': /* FILE PATH */}}, function (body) {
    console.log(body)
});