dynamic news feeds...???

**dvdvault** · 12-16-2002, 09:15 AM

okay dude...u do man

..im off to bed now....TBC...tomorrow

cheers mate

**Subway** · 12-16-2002, 09:27 AM

The insideCG scraper works now!

(Just without the images. I'm not sure what the tag was for them

)

PHP Code:


{dump}<title>{site_name}</title>

{dump}</HEAD>

<link rel="stylesheet" href="styles.css" type="text/css">

<BODY BGCOLOR=#EFEFEF LEFTMARGIN=0 TOPMARGIN=0 MARGINWIDTH=0 MARGINHEIGHT=0 ONLOAD="MM_preloadImages('/menu/news.gif', '/menu/features.gif', '/menu/jobs.gif', '/menu/community.gif','/menu/search.gif','/menu/about.gif','/menu/gotnews.gif');">

{dump}<table width="100%" border="0" cellspacing="0" cellpadding="8">

        <tr>

          <td valign="top">

{dump}            

            <table width="100%" border=0 cellspacing=0 cellpadding=4>

            <tr>

            <td width=150><a href="{link_1}"><img src="{pic_1}" border="0" class="newsImage"></a></td>

            <td valign="top"><span class="newsTitle"><a href="{link_1}">{title_1}</a></span><br>

            <span class="newsDescription">{desc_1}</span></td>

            </tr>

            </table>

{dump}        

            <table width="100%" border=0 cellspacing=0 cellpadding=4>

            <tr>

            <td width=150><a href="{link_2}"><img src="{pic_2}" border="0" class="newsImage"></a></td>

            <td valign="top"><span class="newsTitle"><a href="{link_2}">{title_2}</a></span><br>

            <span class="newsDescription">{desc_2}</span></td>

            </tr>

            </table>

{dump}        

            <table width="100%" border=0 cellspacing=0 cellpadding=4>

            <tr>

            <td width=150><a href="{link_3}"><img src="{pic_3}" border="0" class="newsImage"></a></td>

            <td valign="top"><span class="newsTitle"><a href="{link_3}">{title_3}</a></span><br>

            <span class="newsDescription">{desc_3}</span></td>

            </tr>

            </table>

{dump}        

            <table width="100%" border=0 cellspacing=0 cellpadding=4>

            <tr>

            <td width=150><a href="{link_4}"><img src="{pic_4}" border="0" class="newsImage"></a></td>

            <td valign="top"><span class="newsTitle"><a href="{link_4}">{title_4}</a></span><br>

            <span class="newsDescription">{desc_4}</span></td>

            </tr>

            </table>

{dump}        

            <table width="100%" border=0 cellspacing=0 cellpadding=4>

            <tr>

            <td width=150><a href="{link_5}"><img src="{pic_5}" border="0" class="newsImage"></a></td>

            <td valign="top"><span class="newsTitle"><a href="{link_5}">{title_5}</a></span><br>

            <span class="newsDescription">{desc_5}</span></td>

            </tr>

            </table>

{dump}        

            <table width="100%" border=0 cellspacing=0 cellpadding=4>

            <tr>

            <td width=150><a href="{link_6}"><img src="{pic_6}" border="0" class="newsImage"></a></td>

            <td valign="top"><span class="newsTitle"><a href="{link_6}">{title_6}</a></span><br>

            <span class="newsDescription">{desc_6}</span></td>

            </tr>

            </table>

{dump}        

            <table width="100%" border=0 cellspacing=0 cellpadding=4>

            <tr>

            <td width=150><a href="{link_7}"><img src="{pic_7}" border="0" class="newsImage"></a></td>

            <td valign="top"><span class="newsTitle"><a href="{link_7}">{title_7}</a></span><br>

            <span class="newsDescription">{desc_7}</span></td>

            </tr>

            </table>

{dump}        

            <table width="100%" border=0 cellspacing=0 cellpadding=4>

            <tr>

            <td width=150><a href="{link_8}"><img src="{pic_8}" border="0" class="newsImage"></a></td>

            <td valign="top"><span class="newsTitle"><a href="{link_8}">{title_8}</a></span><br>

            <span class="newsDescription">{desc_8}</span></td>

            </tr>

            </table>

{dump}        

            <table width="100%" border=0 cellspacing=0 cellpadding=4>

            <tr>

            <td width=150><a href="{link_9}"><img src="{pic_9}" border="0" class="newsImage"></a></td>

            <td valign="top"><span class="newsTitle"><a href="{link_9}">{title_9}</a></span><br>

            <span class="newsDescription">{desc_9}</span></td>

            </tr>

            </table>

{dump}        

            <table width="100%" border=0 cellspacing=0 cellpadding=4>

            <tr>

            <td width=150><a href="{link_10}"><img src="{pic_10}" border="0" class="newsImage"></a></td>

            <td valign="top"><span class="newsTitle"><a href="{link_10}">{title_10}</a></span><br>

            <span class="newsDescription">{desc_1}</span></td>

            </tr>

            </table>

{dump}</BODY>

</HTML>

Fredi

Edit: This is the scraper guide: http://www.jmagar.com/modules/MyHead...ne_scraper.htm

**Subway** · 12-16-2002, 10:12 AM

An other feed for you, the Computer Arts Headlines: ( http://www.computerarts.co.uk/news/ )

PHP Code:


{dump}<title>{site_name}</title>

{dump}</head>

{dump}<body bgcolor="#9D3973" text="#000000" link="#000000" vlink="#000000" alink="#000000" leftmargin="0" topmargin="0" marginwidth="0" marginheight="0">

{dump}

        <tr> 

          <td valign="top" width="60"><a href="{link_1}"><img src="{img_1}" width="50" height="50" border="0"></a></td>

          <td valign="top"><a href="{link_1}"> 

            <p class="subhead">{title_1}</p>

            <p class="nounderline">{desc_1}</p></a></td>

        </tr>

        <tr> 

          <td valign="top" colspan="2">&nbsp;</td>

        </tr>

{dump}

        <tr> 

          <td valign="top" width="60"><a href="{link_2}"><img src="{img_2}" width="50" height="50" border="0"></a></td>

          <td valign="top"><a href="{link_2}"> 

            <p class="subhead">{title_2}</p>

            <p class="nounderline">{desc_2}</p></a></td>

        </tr>

        <tr> 

          <td valign="top" colspan="2">&nbsp;</td>

        </tr>

{dump}

        <tr> 

          <td valign="top" width="60"><a href="{link_3}"><img src="{img_3}" width="50" height="50" border="0"></a></td>

          <td valign="top"><a href="{link_3}"> 

            <p class="subhead">{title_3}</p>

            <p class="nounderline">{desc_3}</p></a></td>

        </tr>

        <tr> 

          <td valign="top" colspan="2">&nbsp;</td>

        </tr>

{dump}

        <tr> 

          <td valign="top" width="60"><a href="{link_4}"><img src="{img_4}" width="50" height="50" border="0"></a></td>

          <td valign="top"><a href="{link_4}"> 

            <p class="subhead">{title_4}</p>

            <p class="nounderline">{desc_4}</p></a></td>

        </tr>

        <tr> 

          <td valign="top" colspan="2">&nbsp;</td>

        </tr>

{dump}

        <tr> 

          <td valign="top" width="60"><a href="{link_5}"><img src="{img_5}" width="50" height="50" border="0"></a></td>

          <td valign="top"><a href="{link_5}"> 

            <p class="subhead">{title_5}</p>

            <p class="nounderline">{desc_5}</p></a></td>

        </tr>

        <tr> 

          <td valign="top" colspan="2">&nbsp;</td>

        </tr>

{dump}

        <tr> 

          <td valign="top" width="60"><a href="{link_6}"><img src="{img_6}" width="50" height="50" border="0"></a></td>

          <td valign="top"><a href="{link_6}"> 

            <p class="subhead">{title_6}</p>

            <p class="nounderline">{desc_6}</p></a></td>

        </tr>

        <tr> 

          <td valign="top" colspan="2">&nbsp;</td>

        </tr>

{dump}

        <tr> 

          <td valign="top" width="60"><a href="{link_7}"><img src="{img_7}" width="50" height="50" border="0"></a></td>

          <td valign="top"><a href="{link_7}"> 

            <p class="subhead">{title_7}</p>

            <p class="nounderline">{desc_7}</p></a></td>

        </tr>

        <tr> 

          <td valign="top" colspan="2">&nbsp;</td>

        </tr>

{dump}

        <tr> 

          <td valign="top" width="60"><a href="{link_8}"><img src="{img_8}" width="50" height="50" border="0"></a></td>

          <td valign="top"><a href="{link_8}"> 

            <p class="subhead">{title_8}</p>

            <p class="nounderline">{desc_8}</p></a></td>

        </tr>

        <tr> 

          <td valign="top" colspan="2">&nbsp;</td>

        </tr>

{dump}

        <tr> 

          <td valign="top" width="60"><a href="{link_9}"><img src="{img_9}" width="50" height="50" border="0"></a></td>

          <td valign="top"><a href="{link_9}"> 

            <p class="subhead">{title_9}</p>

            <p class="nounderline">{desc_9}</p></a></td>

        </tr>

        <tr> 

          <td valign="top" colspan="2">&nbsp;</td>

        </tr>

{dump}

        <tr> 

          <td valign="top" width="60"><a href="{link_10}"><img src="{img_10}" width="50" height="50" border="0"></a></td>

          <td valign="top"><a href="{link_10}"> 

            <p class="subhead">{title_10}</p>

            <p class="nounderline">{desc_10}</p></a></td>

        </tr>

        <tr> 

          <td valign="top" colspan="2">&nbsp;</td>

        </tr>

{dump}</body>

</html>

Fredi

Edit: The scraper url must be: http://www.computerarts.co.uk/news/d....asp?diffURL=1 (Don't ask me why

)

**Subway** · 12-17-2002, 04:56 AM

Could you now download the source? Mike's site is up and running again!

Here's an other scraper I jus done (www.creative-3d.net):

PHP Code:


{dump}<title>{site_name}</title>

{dump}</head>

{dump}<body bgcolor="606060">

{dump}

            <tr><td class="newstext">

            {date_1}<br>

            <a href="{link_1}" class="news">{title_1}</a><br>

            {desc_1}</p>

            </td></tr>

{dump}            

            <tr><td class="newstext">

            {date_2}<br>

            <a href="{link_2}" class="news">{title_2}</a><br>

            {desc_2}</p>

            </td></tr>

{dump}            

            <tr><td class="newstext">

            {date_3}<br>

            <a href="{link_3}" class="news">{title_3}</a><br>

            {desc_3}</p>

            </td></tr>

{dump}            

            <tr><td class="newstext">

            {date_4}<br>

            <a href="{link_4}" class="news">{title_4}</a><br>

            {desc_4}</p>

            </td></tr>

{dump}            

            <tr><td class="newstext">

            {date_5}<br>

            <a href="{link_5}" class="news">{title_5}</a><br>

            {desc_5}</p>

            </td></tr>

{dump}            

            <tr><td class="newstext">

            {date_6}<br>

            <a href="{link_6}" class="news">{title_6}</a><br>

            {desc_6}</p>

            </td></tr>

{dump}            

            <tr><td class="newstext">

            {date_7}<br>

            <a href="{link_7}" class="news">{title_7}</a><br>

            {desc_7}</p>

            </td></tr>

{dump}            

            <tr><td class="newstext">

            {date_8}<br>

            <a href="{link_8}" class="news">{title_8}</a><br>

            {desc_8}</p>

            </td></tr>

{dump}

</body>

</html>

The scraper url is: http://www.creative-3d.net/newsviewer.cfm?NewsID=all

I hope you have no problems with the installation, it's not really complicated.

Fredi

**tonytryout** · 12-17-2002, 06:47 AM

I guess moreover is a no go? It was brilliant.

**Subway** · 12-17-2002, 07:01 AM

Originally posted by tonytryout
I guess moreover is a no go? It was brilliant.

Moreover is one of the best sources for RSS feeds. This script just uses them and a huge mass of other feeds and scraped feeds.

The cool thing with myHeadlines is that you can feed almost every db generated headline on every possible site, not just RSS and XML feeds.

Fredi

**dvdvault** · 12-17-2002, 07:16 AM

im still here guys

...just trying to get my site looking decent before i get stuck into this news feed...

will be cak...thanks for all your help dudes...

be back soon

**Subway** · 12-17-2002, 09:16 AM

That's crazy! I just came over thi site: http://myrss.com/new.html

Just enter an url of a site that has news or headlines. I tryd it with my own news (They are feeds from my forum). This is the RSS feed I got: http://myrss.com/f/r/o/rogotworldNews93ozbw1.html

I have no idea how this is done, but it works absolutly perfect!

You can make real RSS feeds from non RSS site without any programming knowledge!

Amazing!

Here's an other try: http://myrss.com/f/f/l/flashmagazineZ2k67z1.html

Perfect!

Or the Flashkit frontpage: http://myrss.com/f/f/l/flashkit7gf7rv1.html

Perfect!

And this are real RSS feeds, so you just need to enter the url into your myHeadlines and it will work! Crazy!

Fredi

**dvdvault** · 12-17-2002, 05:38 PM

Originally posted by Subway
That's crazy! I just came over thi site: http://myrss.com/new.html

Just enter an url of a site that has news or headlines. I tryd it with my own news (They are feeds from my forum). This is the RSS feed I got: http://myrss.com/f/r/o/rogotworldNews93ozbw1.html

I have no idea how this is done, but it works absolutly perfect!

You can make real RSS feeds from non RSS site without any programming knowledge! Amazing!

Here's an other try: http://myrss.com/f/f/l/flashmagazineZ2k67z1.html

Perfect!

Or the Flashkit frontpage: http://myrss.com/f/f/l/flashkit7gf7rv1.html

Perfect!

And this are real RSS feeds, so you just need to enter the url into your myHeadlines and it will work! Crazy!

Fredi

that IS AWESOME!!!!!!!!!!!!

i will get a chance to play with it tonight

Speak to you then dude,

Cheers

**dvdvault** · 12-17-2002, 05:43 PM

just a quick question subway...

when i am doing a channel serch...what exactly do i need to search with..???

Say im looking for news from http://www.cgchannel.com ...???

How would i serch them?

CHeers again dude

**GMF ™** · 12-17-2002, 05:58 PM

.

**dvdvault** · 12-17-2002, 05:59 PM

just as a bit of an OT....i got this from moreover after i emailed them:

Dear Paul,

Thank you for your e-mail.

Moreover is no longer allowing personal or hobby sites to use our free limited news feeds. Personal and hobby sites that have previously obtained the feeds may continue using them at this time, but we will not allow new sign ups going forward. Our updated Terms and Conditions are located at: http://w.moreover.com/main_site/aboutus/terms.html

ahh well....guess ill never know what i missed....myrss.com looks to be the way now (cheers subway)

**Subway** · 12-18-2002, 04:03 AM

Originally posted by dvdvault
Say im looking for news from http://www.cgchannel.com ...???

myRSS don't works with that site: http://www.cgchannel.com/news/archive.jsp

I don't found a RSS feed at the site, so you have to create a scraper template.

If you look at the source of that page, then you see that this part contains one headline:

PHP Code:


                   <table width="90%" border="0" cellspacing="0" cellpadding="0">

                          <tr valign="top"> 

                            <td width="200"><a href="http://www.terminator3.com/

"><img src='/images/news/783/terminator_b.jpg

' border=0></a></td>

                            <td width="10">&nbsp;</td>

                            <td width="180"><font size="2" face="Verdana, Arial, Helvetica, sans-serif">

                            <b>She'll be back!!!

</b><br>

                            <i>Date:</i>

                              <br>

                              The new T3 (Terminator 3) trailer is now available.<br>

<i>Tip by Jason Lee</i>

</font>

                            </td>

                            <td width="100">&nbsp;</td>

                          </tr>

                        </table>

I will try to do a scraper.

Fredi

PS: About moreover, there are other free services like: www.newsisfree.com

**dvdvault** · 12-18-2002, 04:15 AM

cool.....

i was hoping to get a start on stuff tonight...but i have other crap to do...ill post back when i get a chance to spend some time with it...

Cheers dude!!!!!

**tonytryout** · 12-18-2002, 07:37 AM

cool. I am observing this thread closely and learning every minute.

The email from moreover -- yep, that was the one I used. I guess you were a bit too late but it does not matter as Subway's code looks cool and much more flexible.

So Subway, what exactly is involved? What do I need?

**Subway** · 12-18-2002, 07:49 AM

Originally posted by tonytryout
So Subway, what exactly is involved? What do I need?

The myHeadlines script needs a server with PHP and one mySQL database. You can donwload the script at: www.jmagar.com There are different versions for different CMS systems and a standalone version. The installation is very easy, just upload the files and change the parameters in the config file.

The not so easy task is changing the design. All tables and formating is in the main php file, so you need to change it there. Mike Agar is currently working on a template based version, but till this version is out, you need to change the design in the php file.

The installation comes with about six import files. All sources are in this file. There is one for moreover, newsisfree, merkat and other sources. If you can't use moreover, just don't import the moreover .imp file.

The best thing are the scrapers. If you miss a news source in the huge list and that site has no RSS or XML feed, just create a scraper. This is not always easy, but if myRSS don't works with that site, then a scraper is the only way.

Hope that helps.

Fredi

**dvdvault** · 12-18-2002, 08:03 AM

hey subway,

when i eventually get around to doing it (when my site is ready, and ive got the spare time

should be very soon

)...is it cool if you can do a little 'hand holding'???...

Again, i have to thanksyou for this freaking awesome recommendation!!!!!

u r a champion!!!

Also, rogotworld looks very cool...did you do all the design and php scripting??

Cheers mate!!

**Subway** · 12-18-2002, 08:10 AM

Yup, now problem, I can hold your hand. Are you a girl?

And yes, I did much everything at the site. Of course most of the scripts are free scripts and not coded by me. (Some are a bit modificated)

Anyway, here's the scraper for http://www.cgchannel.com/news/archive.jsp

PHP Code:


{dump}<title>Cgchannel.com Archives</title>

{dump}</head>

{dump}<body bgcolor="#EEEEEE" text="#000000">

{dump}<table width="90%" border="0" cellspacing="0" cellpadding="0">

                          <tr valign="top"> 

                            <td width="200"><a href="{link_1}"><img src='{img_1}

' border=0></a></td>

                            <td width="10">&nbsp;</td>

                            <td width="180"><font size="2" face="Verdana, Arial, Helvetica, sans-serif">

                            <b>{title_1}

</b><br>

                            <i>{date_1}</i>

                              <br>

                              {desc_1}

</font>

                            </td>

                            <td width="100">&nbsp;</td>

                          </tr>

                        </table>

{dump}<table width="90%" border="0" cellspacing="0" cellpadding="0">

                          <tr valign="top"> 

                            <td width="200"><a href="{link_2}"><img src='{img_2}

' border=0></a></td>

                            <td width="10">&nbsp;</td>

                            <td width="180"><font size="2" face="Verdana, Arial, Helvetica, sans-serif">

                            <b>{title_2}

</b><br>

                            <i>{date_2}</i>

                              <br>

                              {desc_2}

</font>

                            </td>

                            <td width="100">&nbsp;</td>

                          </tr>

                        </table>

{dump}<table width="90%" border="0" cellspacing="0" cellpadding="0">

                          <tr valign="top"> 

                            <td width="200"><a href="{link_3}"><img src='{img_3}

' border=0></a></td>

                            <td width="10">&nbsp;</td>

                            <td width="180"><font size="2" face="Verdana, Arial, Helvetica, sans-serif">

                            <b>{title_3}

</b><br>

                            <i>{date_3}</i>

                              <br>

                              {desc_3}

</font>

                            </td>

                            <td width="100">&nbsp;</td>

                          </tr>

                        </table>

{dump}<table width="90%" border="0" cellspacing="0" cellpadding="0">

                          <tr valign="top"> 

                            <td width="200"><a href="{link_4}"><img src='{img_4}

' border=0></a></td>

                            <td width="10">&nbsp;</td>

                            <td width="180"><font size="2" face="Verdana, Arial, Helvetica, sans-serif">

                            <b>{title_4}

</b><br>

                            <i>{date_4}</i>

                              <br>

                              {desc_4}

</font>

                            </td>

                            <td width="100">&nbsp;</td>

                          </tr>

                        </table>

{dump}<table width="90%" border="0" cellspacing="0" cellpadding="0">

                          <tr valign="top"> 

                            <td width="200"><a href="{link_5}"><img src='{img_5}

' border=0></a></td>

                            <td width="10">&nbsp;</td>

                            <td width="180"><font size="2" face="Verdana, Arial, Helvetica, sans-serif">

                            <b>{title_5}

</b><br>

                            <i>{date_5}</i>

                              <br>

                              {desc_5}

</font>

                            </td>

                            <td width="100">&nbsp;</td>

                          </tr>

                        </table>

{dump}<table width="90%" border="0" cellspacing="0" cellpadding="0">

                          <tr valign="top"> 

                            <td width="200"><a href="{link_6}"><img src='{img_6}

' border=0></a></td>

                            <td width="10">&nbsp;</td>

                            <td width="180"><font size="2" face="Verdana, Arial, Helvetica, sans-serif">

                            <b>{title_6}

</b><br>

                            <i>{date_6}</i>

                              <br>

                              {desc_6}

</font>

                            </td>

                            <td width="100">&nbsp;</td>

                          </tr>

                        </table>

{dump}<table width="90%" border="0" cellspacing="0" cellpadding="0">

                          <tr valign="top"> 

                            <td width="200"><a href="{link_7}"><img src='{img_7}

' border=0></a></td>

                            <td width="10">&nbsp;</td>

                            <td width="180"><font size="2" face="Verdana, Arial, Helvetica, sans-serif">

                            <b>{title_7}

</b><br>

                            <i>{date_7}</i>

                              <br>

                              {desc_7}

</font>

                            </td>

                            <td width="100">&nbsp;</td>

                          </tr>

                        </table>

{dump}<table width="90%" border="0" cellspacing="0" cellpadding="0">

                          <tr valign="top"> 

                            <td width="200"><a href="{link_8}"><img src='{img_8}

' border=0></a></td>

                            <td width="10">&nbsp;</td>

                            <td width="180"><font size="2" face="Verdana, Arial, Helvetica, sans-serif">

                            <b>{title_8}

</b><br>

                            <i>{date_8}</i>

                              <br>

                              {desc_8}

</font>

                            </td>

                            <td width="100">&nbsp;</td>

                          </tr>

                        </table>

{dump}<table width="90%" border="0" cellspacing="0" cellpadding="0">

                          <tr valign="top"> 

                            <td width="200"><a href="{link_9}"><img src='{img_9}

' border=0></a></td>

                            <td width="10">&nbsp;</td>

                            <td width="180"><font size="2" face="Verdana, Arial, Helvetica, sans-serif">

                            <b>{title_9}

</b><br>

                            <i>{date_9}</i>

                              <br>

                              {desc_9}

</font>

                            </td>

                            <td width="100">&nbsp;</td>

                          </tr>

                        </table>

{dump}<table width="90%" border="0" cellspacing="0" cellpadding="0">

                          <tr valign="top"> 

                            <td width="200"><a href="{link_10}"><img src='{img_10}

' border=0></a></td>

                            <td width="10">&nbsp;</td>

                            <td width="180"><font size="2" face="Verdana, Arial, Helvetica, sans-serif">

                            <b>{title_10}

</b><br>

                            <i>{date_10}</i>

                              <br>

                              {desc_10}

</font>

                            </td>

                            <td width="100">&nbsp;</td>

                          </tr>

                        </table>

{dump}</body>

</html>

Works fine.

Fredi

**dvdvault** · 12-18-2002, 08:14 AM

ok...before we embark on this journey of news-related php terror

...i have to official state that i am 'all man'

i have just downloaded the standalone version and the documentation...im going to start working on it now!!!

...so...ill probably be posting for help in about..mmm...3 minutes

...

Cheers dude!!...ill be intouch (sooner probably than later)

**dvdvault** · 12-18-2002, 08:46 AM

subway....you there???

do you have a Messenger account we could chat on??

Thread: dynamic news feeds...???

Thread Tools

Display

Moved to General Help

Posting Permissions