That's great you solved it - yes, it's odd that it told you "server not responding" where instead of I don't know telling you didn't set a content type.
Well, no, it's not that easy to do - the code for a scraper is fairly complicated (regular expressions and rules and so on) and usually it does that by parsing the contents of web page (at least in the case of IMDB), pages that may change format or might be even slightly different per movie entry, meaning that it will not always work and it can break at any time when the website changes. For that reason TMDb is recommended as it has a hard, well defined XML structure for the content, as opposed to IMDB that uses the HTML contents of the webpage.
http://www.xbmc4xbox.org.uk/wiki/Scrapers