Running numerous Virtual Machines in headless mode can be extremely irritating; having to memorise several commands to run in the terminal or constantly open and close VirtualBox in order to control them. Thankfully not any more.
In my last article I discussed the different techniques that could be used in order to scrape Google’s search engine without being detected. This week we’ll be looking at creating a script to scrape another popular search engine – Bing, using the API which Microsoft provide. It should be noted that Google also provide an API; which allows you to make 100 queries a day (approx 3000 / month); compared to 5000 queries a month with Microsoft Bing.
Using the API is certainly the recommended method for scraping results from either search engine, and the previous article should only be used for education purposes. Wink Wink.
The Whatpulse widget for WordPress is a handy plugin for WordPress which allows you to display either your individual or team (or both) statistics on your Whatpulse blog. All you need to know is your Whatpulse ID and you’re good to go, simply select which statistics you want to appear.