Twitter processor

(by nicholas, last updated: jun 2013)

peuso code:

get text
get hashtags
get keyword
get sentiment (API)
get url scores:
  for each url:
      request page (pagefetcher)
      score page
  calculate score
aggregate data into result
create entity from tweet: