| |
Haven't registered yet? Do it here now!
 |
|
 |
|
SimonSays
Joined: 05 Nov 2007
Posts: 11
|
|
|
 |
|
 |
|
 Posted: Mon Mar 17, 2008 1:44 pm Post subject: Morphing feeds seem to be a problem |
 |
|
|
 |
|
 |
|
|
|
|
Hiya Kaktus,
I've recently added some sponsor feeds which are promoted as being "morphing feeds" which automatically generate different post titles and slightly different post text for each affiliate who uses them. The posts are not really all that different, only a few words are replaced, and the images included in the posts are the same. The sponsor is doing this as positive thing in an attempt to avoid duplicate content penalties for affiliates.
Unfortunately, it seems that BA is adding multiple versions of the same post to its database when it crawls these feeds, and so I'm winding up with multiple versions of the same post on my blog, same photos and only a few words different on each post.
Have you run across this problem before? The morphing feeds are getting more popular among sponsors these days, so we really need some way to avoid having these (almost) duplicates posted to our blogs.
Simon
(GG&J) |
|
|
|
|
|
|
|
Atanasis
Owner
Joined: 22 May 2004
Posts: 4284
Location: The Net
|
|
|
|
|
|
|
| Posted: Mon Mar 17, 2008 2:43 pm Post subject: |
|
|
|
|
|
|
|
|
|
|
hi there,
well if the titles of the posts get changed each time the feed is accessed, yes they will be added to BA database and will generate a dup of previously crawled post. This probably happens for each blog rss feeding script, since all use the title of the entries to determine are they unique or no.
I just looked in my BA database at several sponsors having morphing rss feeds and they are fine, no duplicate entries. All they use the feedninjas morphing service and as long as i see they change words in the body of the post, but title remains untouched.
if the sponsor you tried is changing and titles, there is nothing me or other coder can do about..
_________________
Thanks,
Kaktusan
 |
|
|
|
|
|
|
|
SimonSays
Joined: 05 Nov 2007
Posts: 11
|
|
|
|
|
|
|
| Posted: Mon Mar 17, 2008 5:36 pm Post subject: |
|
|
|
|
|
|
|
|
|
|
Yes, the post titles are indeed changed each time.
I'll send you a pm with details on the sponsor so you can take a look. Maybe the posts have some field content in common which could be used to match them and exclude the dupes. Or maybe you can show the sponsor a better way to do things. They do have good feeds aside from this problem. |
|
|
|
|
|
|
|
Atanasis
Owner
Joined: 22 May 2004
Posts: 4284
Location: The Net
|
|
|
|
|
|
|
| Posted: Mon Mar 17, 2008 6:39 pm Post subject: |
|
|
|
|
|
|
|
|
|
|
ok, thanks, will take a look 
_________________
Thanks,
Kaktusan
|
|
|
|
|
|
|
|
SimonSays
Joined: 05 Nov 2007
Posts: 11
|
|
|
|
|
|
|
| Posted: Tue Mar 18, 2008 3:41 pm Post subject: |
|
|
|
|
|
|
|
|
|
|
Sending you another pm via the board with a reply I got from that sponsor.
As usual they blame "not them."  |
|
|
|
|
|
|
|
Atanasis
Owner
Joined: 22 May 2004
Posts: 4284
Location: The Net
|
|
|
|
|
|
|
| Posted: Tue Mar 18, 2008 4:07 pm Post subject: |
|
|
|
|
|
|
|
|
|
|
ok, lol yeah..
_________________
Thanks,
Kaktusan
|
|
|
|
|
|
|
|
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
|
Powered by phpBB © 2001, 2002 phpBB Group
|
 |
|
 |
| |
