gfors's Avatar
gfors 4
21 Asked
35 Answered
7 Best
1
No one has voted on this question yet :(
3 years, 3 months ago

What is the best news aggregation api?

I require a service that feeds up to date, news related articles (just the header with slug) & multimedia based on simple or complex search criteria as warranted. Content needs to be in a standardized, publishable format. Access must be through an API. Please offer pros and cons based on experience, simply a list of links will not be considered helpful.

Free is not a requirement, I require an enterprise type solution.

Equal consideration for answers explaining why not to use a given service.
Tip for best answer: M$2.00
Separate topics with commas, or by pressing return. Use the delete or backspace key to edit or remove existing topics.

You can leave an optional "tip" with Mahalo's virtual currency, Mahalo Dollars. If you are asking a difficult question that might require some research, or if you'd like a wide variety of feedback, a higher tip often leads to more answers to your question.

M$

What is Your Answer?

0
0
0

4 Answers

1
erlog's Avatar
erlog | 3 years, 3 months ago
3
The thing you need to be worried about if you use something like this, for free, is that someone might own the content you're aggregating. They might not be happy with you making use of this for your own project. This is why services such as the Associated Press news wire exist. So, if you are suggested an option, I would be wary of the legality of any of the ones that are purporting to be free. Big news websites pay good money for a reason to license any of the content they aggregate.

The way Google gets around this for Google News is that Google does not serve up whole articles directly on its website. Google News simply gives people links to stories with a little bit of information about those links.

If this is for your own personal enjoyment then this is obviously not an issue, but I can't think of why you would need an API for your personal project. In that case you could use Google News with email alerts for search terms. I realize that this probably doesn't help you, but I just want to confirm the sort of project you have in mind.

You can leave an optional "tip" with Mahalo's virtual currency, Mahalo Dollars. If you are asking a difficult question that might require some research, or if you'd like a wide variety of feedback, a higher tip often leads to more answers to your question.

M$
gfors's Avatar
gfors | 3 years, 3 months ago Report

Thanks for the Answer!

Let me state, free is not a requirement.

I should have specified that in the case of news stories I am simply looking for the headline + intro rss style content, these days even that has come under legal attack.

The problem with Google's feed, as I recall, is the inconsistencies in markup/format. Its a direct republishing of the orig rss, which is all over the place, feeding this into interface is not optimal to say the least.

Report Abuse

Post Reply Cancel
1
robbrown's Avatar
robbrown | 3 years, 3 months ago
4
http://magpierss.sourceforge.net/

Magpie is super easy to use. I love it. In litterally 2 lines, you can fetch an RSS feed. Then, it's quite easy to phrase the contents of the RSS feed into an array to aggregate as you'd like.

Here's how I use it:
I like to supplement my blog with related news from other related sites. I've setup magpie to pull in the RSS feeds 4 times a day and then apply some simple logic (if title contains, if story contains, that sort of thing) and give credit to the original source. I write my new aggregated feed and have my copy of wordpress setup to import that feed.

You can leave an optional "tip" with Mahalo's virtual currency, Mahalo Dollars. If you are asking a difficult question that might require some research, or if you'd like a wide variety of feedback, a higher tip often leads to more answers to your question.

M$

Report Abuse

Post Reply Cancel
0
hobinrood's Avatar
hobinrood | 3 years, 3 months ago
0
Try Yahoo Pipes. You can build a lot of rules, customize what you need, from where, the size of content... it is very flexible.

Pre-req - some knowledge on how feeds work, and ability to define simple rules.

You can leave an optional "tip" with Mahalo's virtual currency, Mahalo Dollars. If you are asking a difficult question that might require some research, or if you'd like a wide variety of feedback, a higher tip often leads to more answers to your question.

M$
hobinrood's Avatar
hobinrood | 3 years, 3 months ago Report

There are a lot of examples which you can copy and extend, if that helps.

gfors's Avatar
gfors | 3 years, 3 months ago Report

Pipes is awesome, but its not a real solution as much as its cool as hell. Defining new criteria is a bit of a pain and you would need a fair bit of training if you were a jschool type.

I'm looking for an enterprise type solution.

Report Abuse

Post Reply Cancel
-1
artifexcrastinus's Avatar
artifexcrastinus | 3 years, 3 months ago
3
I suggest using Google Reader and Google New Alerts. You can set search criteria for the Google alert and have it output as either emails that that get sent out in specified intervals or as an RSS feed. This RSS feed I believe would easily be used by an API. You can use Google Reader (an RSS feed reader) to check the content before you run the API.

I hope that helps. Not really familiar with the other "news aggregation" APIs, but Google has the best search algorithms of which I know. Many features are not explicitly explained by them so you may want to google "google tips" or "google secrets" to unlock its full potential.
source(s):
www.google.com of course

You can leave an optional "tip" with Mahalo's virtual currency, Mahalo Dollars. If you are asking a difficult question that might require some research, or if you'd like a wide variety of feedback, a higher tip often leads to more answers to your question.

M$

Report Abuse

Post Reply Cancel

Learn something new with our FREE educational apps!

Private lessons in the comfort of your own home. Get back in shape or finally pick up a guitar with our great experts guiding you the whole way!
Learn Guitar
Learn Hip Hop
Learn Pilates