Automatically downloading urls included in RSS Feed

Newsgator Forums
Home       Members    Calendar    Who's On
Welcome Guest ( Login | Register )
        


Automatically downloading urls included in RSS Feed Expand / Collapse
Author
Message
Posted 11/16/2008 6:57:47 AM
Forum Member

Forum Member

Group: Forum Members
Last Login: 11/21/2008 4:05:36 PM
Posts: 5, Visits: 6
I'm new to this forum and to newsgator.  Any help you can provide is greatly appreciated.

I need to automatically download 'attachments' (embedded urls) from a specific RSS feed on a daily basis. 

The rss feed is: http://www.sec.gov/Archives/edgar/xbrlrss.xml.  Contained in this feed are urls to each file I need to download. 

The following is a line from the 'xbrlrss.xml' that contains an url to one of the files. 

<edgar:xbrlFile sequence="2" file="pzza-20080928.xml" type="EX-100.INS" size="206854" description="EX-100.INS"
url="http://www.sec.gov/Archives/edgar/data/901491/000110465908069908/pzza-20080928.xml" />

This feed contains over 3,800 urls.  I only need to download those urls that I had not previously downloaded.

I can't find an option in newsgator to automatically download these files.  Am I missing something?

Thanks!

Mathelo

Louis

Post #44325
Posted 11/18/2008 5:53:18 AM
Forum Member

Forum Member

Group: Forum Members
Last Login: 11/21/2008 4:05:36 PM
Posts: 5, Visits: 6
Can anyone help with this question?  Please

Louis
Post #44361
Posted 11/19/2008 9:14:49 PM
Forum Member

Forum Member

Group: Forum Members
Last Login: 11/21/2008 4:05:36 PM
Posts: 5, Visits: 6
Have I posted this question in the right place?  The silence is deafening...

Mathelo1 (11/16/2008)
I'm new to this forum and to newsgator.  Any help you can provide is greatly appreciated.

I need to automatically download 'attachments' (embedded urls) from a specific RSS feed on a daily basis. 

The rss feed is: http://www.sec.gov/Archives/edgar/xbrlrss.xml.  Contained in this feed are urls to each file I need to download. 

The following is a line from the 'xbrlrss.xml' that contains an url to one of the files. 

<edgar:xbrlFile sequence="2" file="pzza-20080928.xml" type="EX-100.INS" size="206854" description="EX-100.INS"
url="http://www.sec.gov/Archives/edgar/data/901491/000110465908069908/pzza-20080928.xml" />

This feed contains over 3,800 urls.  I only need to download those urls that I had not previously downloaded.

I can't find an option in newsgator to automatically download these files.  Am I missing something?

Thanks!

Mathelo



Louis
Post #44430
Posted 11/20/2008 6:09:55 AM


NewsGator

NewsGator

Group: Administrators
Last Login: Yesterday @ 8:29:11 PM
Posts: 1,679, Visits: 41,581
Sorry for the slow response, Louis!  The short answer is that while FeedDemon can download files from many RSS feeds, it can't download them from this one.

FeedDemon does have the ability to automatically download files, but only when they're linked into the feed using the standard RSS enclosure syntax.  I downloaded the feed you provided, and rather than use RSS enclosures, it uses XBRL to point to "attached" files - and FeedDemon doesn't support XBRL at this time.

Best regards,


Nick Bradbury
Nick's Blog

Post #44434
Posted 11/20/2008 6:55:49 PM
Forum Member

Forum Member

Group: Forum Members
Last Login: 11/21/2008 4:05:36 PM
Posts: 5, Visits: 6
Nick,

Thanks for your reply.

I recognize that if the RSS enclosure syntax was being used, this would be easier, but I'm a bit surprised there isn't a simple function or feature available to download these embedded links.  I'm not a programmer, so I can't easily do this.  However, I am able to open the xbrlrss.xml file in Excel and then import the urls into Download Manager.  From there it is a fairly simple process but it is neither automatic, like an RSS Enclosure would be, or incremental.

Are you aware of any available plugins or scripts that could handle this?

Louis

Nick Bradbury (11/20/2008)
Sorry for the slow response, Louis!  The short answer is that while FeedDemon can download files from many RSS feeds, it can't download them from this one.

FeedDemon does have the ability to automatically download files, but only when they're linked into the feed using the standard RSS enclosure syntax.  I downloaded the feed you provided, and rather than use RSS enclosures, it uses XBRL to point to "attached" files - and FeedDemon doesn't support XBRL at this time.

Best regards,



Louis
Post #44462
Posted 11/20/2008 9:27:56 PM


NewsGator

NewsGator

Group: Administrators
Last Login: Yesterday @ 8:29:11 PM
Posts: 1,679, Visits: 41,581
Mathelo1 (11/20/2008)
Are you aware of any available plugins or scripts that could handle this?

I'm afraid not.  Honestly, until you posted here, I hadn't seen a feed use XBRL extensions.

Nick Bradbury
Nick's Blog

Post #44464
Posted 11/21/2008 9:37:13 AM


Rockstar

Rockstar

Group: Forum Members
Last Login: Today @ 2:35:36 AM
Posts: 247, Visits: 1,468
Out of curiosity I ran the feed through the Feed Validator and it doesn't validate as an RSS or Atom feed.
Post #44479
Posted 11/21/2008 4:08:26 PM
Forum Member

Forum Member

Group: Forum Members
Last Login: 11/21/2008 4:05:36 PM
Posts: 5, Visits: 6
Yes, that is correct.  I don't know why they didn't make it rss valid (and I have made a request that this be included) but in the short-term it won't get fixed so I was hoping for a workaround.

Alan Palmer (11/21/2008)
Out of curiosity I ran the feed through the Feed Validator and it doesn't validate as an RSS or Atom feed.


Louis
Post #44492
Posted 12/4/2008 2:40:22 AM
Forum Member

Forum Member

Group: Forum Members
Last Login: 12/5/2008 5:45:04 AM
Posts: 1, Visits: 4
Louis,

I suggest you try Yahoo Pipes to rewrite the feed to meet your needs.

jfp


--
jfp
Post #44728
« Prev Topic | Next Topic »

All times are GMT -7:00, Time now is 3:09am

Powered By InstantForum.NET v4.1.4 © 2009
Execution: 0.109. 8 queries. Compression Disabled.

NewsGator.com | Support | Developers | Partners | Press | Company
© Copyright 2003-2009  NewsGator Technologies, Inc. All Rights Reserved.
Copyright Information | Privacy Policy | Terms of Service
Microsoft Gold Certified Partner