| |
Haven't registered yet? Do it here now!
|
Amy
Joined: 13 Dec 2007
Posts: 14
|
|
|
 |
|
 |
|
 Posted: Wed Mar 25, 2009 10:41 pm Post subject: Understanding Feed Crawls, Update Intervals, & Blog Post |
 |
|
|
 |
|
 |
|
|
|
|
Hello,
I'm curious to know...
[1] If I have 1000 rss feeds in the system, a campaign that uses "All Feeds," and the update interval is set to 60... then how many posts will be sent to the blog every hour? Just one post per hour? Or ALL new posts from ALL the feeds that occurred since the last update?
[2] Is it dangerous to have 1000, 2000, 5000 or 10000 feeds in the system with hourly or even daily "All Feeds" crawls? Will that kill the server?
Thank you! |
|
|
|
|
|
|
|
Atanasis
Owner
Joined: 22 May 2004
Posts: 4284
Location: The Net
|
|
|
|
|
|
|
| Posted: Thu Mar 26, 2009 1:56 am Post subject: |
|
|
|
|
|
|
|
|
|
|
1. it will publish 1 new post every hour. The number of feeds/sponsors/categories selected for the campaign, have nothing to do with the number of posts being published. They are just to tell the script from where to pick posts.
2. yeah, having those big numbers of feeds and making the script crawl them hourly will definitely cause a load. Generally there isn't need to recrawl feeds that often, normally once every couple of days is fine, since i don't suppose 10k feeds will update daily.
_________________
Thanks,
Kaktusan
 |
|
|
|
|
|
|
|
Amy
Joined: 13 Dec 2007
Posts: 14
|
|
|
|
|
|
|
| Posted: Fri Mar 27, 2009 4:16 am Post subject: |
|
|
|
|
|
|
|
|
|
|
Atanasis,
Thank you for your thorough explanation I really appreciate it!
I have just one more hypothetical question for you (I know it's weird, but)....
Let's say I have 100,000 posts already in the BA database...
Only 1 campaign that pulls from "All Posts"...
10 keywords...
Random...
No rewrites...
How much of a stress will that campaign place on the server if it runs every 60 minutes?
Again, I know it's unusual, but I'm brainstorming new ideas.
Thanks again! |
|
|
|
|
|
|
|
Atanasis
Owner
Joined: 22 May 2004
Posts: 4284
Location: The Net
|
|
|
|
|
|
|
| Posted: Fri Mar 27, 2009 1:21 pm Post subject: |
|
|
|
|
|
|
|
|
|
|
campaigns don't put much stress on the server, because they simply pull one post from the database and push it to the blog. The number of posts in db and such stuff, doesn't make a difference.
Ofcourse unless you have really high amount of campaigns set to run pretty pretty frequent.
Anyways, the most heavyweight thing in the script is crawling the feeds. The campaigns are lightweight..
_________________
Thanks,
Kaktusan
|
|
|
|
|
|
|
|
Amy
Joined: 13 Dec 2007
Posts: 14
|
|
|
|
|
|
|
| Posted: Fri Mar 27, 2009 9:33 pm Post subject: |
|
|
|
|
|
|
|
|
|
|
| Splendid information, Atanasis. Thank you very much! |
|
|
|
|
|
|
|
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
|
Powered by phpBB © 2001, 2002 phpBB Group
|
 |
|
 |
| |
