| |
Haven't registered yet? Do it here now!
 |
|
 |
|
tube2k
Joined: 16 Jul 2010
Posts: 19
|
|
|
 |
|
 |
|
 Posted: Sat Jul 16, 2011 9:57 pm Post subject: Smart Checker and more. |
 |
|
|
 |
|
 |
|
|
|
|
Question. There are 4 options for the 'smart checker' setting.
Does the very first option "Enabled: Yes/No Enable some advanced checks on the trades." need to be set to YES to use the "Check Max Out Links function?
Question. Why is the script sending emails to traders if the trade is flagged with BLACK text (ie "Cant connect to host", etc)?
Is there a way to specify a separate email template for just those types of trades? I have trader who think their trades are being disabled due to this.
Question. If I have the script set to "Disable just from site and email trader" when checking links, why am I seeing that some trades are still enabled even though they are flagged from the latest link check as "No Recip Found"? Also, there are some trades that are flagged as "No Recip Found" but when I go to look at the trade details, the trade is still enabled and the backlink DOES INDEED exist on the trader's site... why...?
Sorry for all the questions, but with 24k trades in the database it's imperative that things run smooth  |
|
|
|
|
|
|
|
Atanasis
Owner
Joined: 22 May 2004
Posts: 4284
Location: The Net
|
|
|
|
|
|
|
| Posted: Mon Jul 18, 2011 8:10 am Post subject: |
|
|
|
|
|
|
|
|
|
|
hi there,
1. yes the Smart checker needs to be enabled for the Max Out links to be checked as well.
2. I have fixed trades with BLACK text not to be emailed. For next version i can create separate email template for them.. Let me know your php version so i can send you a patch..
3. When you have "no recip found" trade, but you suspect the recip is fine on the trade, you can check the error file for that trade. There are various reasons why your server might not see the recip, so it is always good to check error file..
About the trades disabling, never had problems with that and just looked at the code and all looks right....
_________________
Thanks,
Kaktusan
 |
|
|
|
|
|
|
|
tube2k
Joined: 16 Jul 2010
Posts: 19
|
|
|
|
|
|
|
| Posted: Tue Jul 19, 2011 8:08 pm Post subject: |
|
|
|
|
|
|
|
|
tube2k
Joined: 16 Jul 2010
Posts: 19
|
|
|
|
|
|
|
| Posted: Wed Jul 20, 2011 8:01 pm Post subject: |
|
|
|
|
|
|
|
|
|
|
| Please let me know when the patch will be available for download, or send me a link in private message here or something for faster access to it. Thanks. |
|
|
|
|
|
|
|
Atanasis
Owner
Joined: 22 May 2004
Posts: 4284
Location: The Net
|
|
|
|
|
|
|
| Posted: Thu Jul 21, 2011 3:09 pm Post subject: |
|
|
|
|
|
|
|
|
|
|
you have a pm with the patch details..
_________________
Thanks,
Kaktusan
|
|
|
|
|
|
|
|
tube2k
Joined: 16 Jul 2010
Posts: 19
|
|
|
|
|
|
|
| Posted: Mon Aug 15, 2011 7:21 pm Post subject: |
|
|
|
|
|
|
|
|
|
|
After applying this patch, the cron does not work anymore, the link checker gets stuck. We get emails saying link check finished, but there is no report to view. 2 months ago, our bandwidth usage jumped approx 1000% and has stayed there ever since.
according to the host, I guess the cron is not handling traffic correctly or something, because right after the host killed the process, the bandwidth usage dropped back to normal levels.
attached is the example of what the host is saying:
 [/img] |
|
|
|
|
|
|
|
tube2k
Joined: 16 Jul 2010
Posts: 19
|
|
|
|
|
|
|
| Posted: Tue Aug 16, 2011 3:34 am Post subject: |
|
|
|
|
|
|
|
|
|
|
| 30 minutes after I posted here, I started the link checker manually. I now have what I believe is about 12000 files inside my /temp folder. Could that be causing issues? |
|
|
|
|
|
|
|
Atanasis
Owner
Joined: 22 May 2004
Posts: 4284
Location: The Net
|
|
|
|
|
|
|
| Posted: Tue Aug 16, 2011 10:41 am Post subject: |
|
|
|
|
|
|
|
|
|
|
having that many files in /temp/ means there is serious problem with your server connectivity.. those files are written only when there's a problem with a trade..
_________________
Thanks,
Kaktusan
|
|
|
|
|
|
|
|
tube2k
Joined: 16 Jul 2010
Posts: 19
|
|
|
|
|
|
|
| Posted: Tue Aug 16, 2011 8:50 pm Post subject: |
|
|
|
|
|
|
|
|
|
|
Can you debug this?
I ended up getting a mysq has gone away message 12 hours after i started the link checker, so i disabled the smart checker altogether (which was checking for max outlinks) and I guess it successfully ran |
|
|
|
|
|
|
|
|
|
|
tube2k
Joined: 16 Jul 2010
Posts: 19
|
|
|
|
|
|
|
| Posted: Tue Aug 16, 2011 9:33 pm Post subject: |
|
|
|
|
|
|
|
|
|
|
A couple months ago I had mentioned wanting a 'recheck' feature that would check any trades that are listed in the report that is saved after the link check runs.
We are in dire need of this feature since the script is erroneously marking good trades as bad ones and disabling them, as well as disabling trades that are in black, still, as I mentioned to you before.
Is this something that you think you can get added like as soon as possible or do I need to find another link management script to use? It really would be unfortunate because we already need additional copies for mainstream and such, and this script is excellent, but it's causing us too many issues that aren't getting solved.
Don't get me wrong, please. We DO understand that there is always going to be a margin of error when running these types of scripts and you and I both know what they are (server offline etc) but What we used to do was just reverify the ones marked as bad in linkex. Rerunning the link checker from base is not a solution to the problem because now we would be sending out repeated emails instead of just one.
The best suggestion that we have come up with is to add an individual "Reverify" button next to each trade that was flagged in the first report, as well as a button at the bottom of the report to "Reverify All". When re-verify or Re-Verify All is clicke,d it would check the site(s) then refresh the report, and echo a message at the top of the page with the action taken on the specific trade like "Trade Re-Verified, and Disabled" or "trade re-verified and marked active" (also put a "view trade" link next to this message.
This would be an almost perfect solution if we can get the features here, but as I mentioned before, we are in dire need of either a solution with new features (necessary features, mind you) or can also be solved by going to another link management script. We really don't want to make the latter be our choice  |
|
|
|
|
|
|
|
|
|
|
Atanasis
Owner
Joined: 22 May 2004
Posts: 4284
Location: The Net
|
|
|
|
|
|
|
| Posted: Tue Aug 16, 2011 10:22 pm Post subject: |
|
|
|
|
|
|
|
|
|
|
how much time it takes the linkchecker to complete and how much trades you have total in the db..? You can see it from bottom left corner of the home page..
The latest patch i sent you has nothing more changed than commenting one line not to email trades reported in black text. So whatever you results had with the previous versions, the same you will have and with this one..
The smart linkchecker is not putting any extra load on the checker, as it is doing just caclulations. The biggest load for the checker is connecting to each trade and downloading its content, so it can use it to scan for recip, for out links or whatsoever..
It might be possible that php is leaking in resources or just getting blown up because you have real big amount of trades to process. It could be some server limits getting it blown up or something like that again because you have big amount of trades to process. The deal is that it is processing everything at once in one process instance.. Maybe i could try to split it aparts... like cronjob is running each hour and each hour the checker to check a portion of all your trades.. not all at once..
The "reverify" feature you are requesting can't be made exactly like you are requesting. When you are saying it takes more than 12 hours for the checker to run, you don't expect to sit on the pc and wait 2-3 hours (probably) for the reverify to finish, do you? No to mention your browser will cut you out.. best for such long processes is a cronjob.. Also it is unwise to have it disable trades first and after that if they prove otherwiser to reenable them again.. Also what happens if you are on a holiday and can't manually run the reverify?
What could be done is for me to make an option "use reverify of report" and when that option is enabled the first time the script runs will save a temp report with the bad trades and no action will be taken at that time, when it completes it starts again to recheck just these bad trades.. when the trade is again bad, then action is taken.. if the trade proves to be good nothing is done.. So at the end on first run it gets the bad ones, on second run rechecks to make sure they are bad and then do the necessary action and emailing..
_________________
Thanks,
Kaktusan
|
|
|
|
|
|
|
|
|
|
|
tube2k
Joined: 16 Jul 2010
Posts: 19
|
|
|
|
|
|
|
| Posted: Wed Aug 17, 2011 1:25 am Post subject: |
|
|
|
|
|
|
|
|
|
|
| Atanasis wrote: | | how much time it takes the linkchecker to complete and how much trades you have total in the db..? You can see it from bottom left corner of the home page.. |
Well, I deleted the cronjob from cpanel, then I started link checker at 2:06PM(and left browser open as instructed). At 2AM the next morning, I checked the screen that I still left open and it said that MySQL Server Has Gone Away. Keep in mind, this is with the Smart Checker counting max outlinks.
I then restarted the Link Checker at 4AM with the Smart Check disabled completely, and it completed in 504 minutes. The Error Report has flagged and disabled dozens of legitimate and GOOD trades, where the backlinks DO exist, I verified them with my own two pearly white eyes lol.
| Quote: | | The latest patch i sent you has nothing more changed than commenting one line not to email trades reported in black text. So whatever you results had with the previous versions, the same you will have and with this one.. |
See my next reply to quote
| Quote: | | The smart linkchecker is not putting any extra load on the checker, as it is doing just caclulations. The biggest load for the checker is connecting to each trade and downloading its content, so it can use it to scan for recip, for out links or whatsoever.. |
This would explain the giant increase in bandwidth as of a couple weeks ago. I didnt directly accuse the patch you sent to me as being the culprit. I honestly think that the bandwidth usage spike began when I enabled the smart checker. I will post another reply with my 7 day stats to see if disabling the smart checker lowered my bandwidth usage.
| Quote: | | It might be possible that php is leaking in resources or just getting blown up because you have real big amount of trades to process. It could be some server limits getting it blown up or something like that again because you have big amount of trades to process. The deal is that it is processing everything at once in one process instance.. Maybe i could try to split it aparts... like cronjob is running each hour and each hour the checker to check a portion of all your trades.. not all at once.. |
That's not a terrible idea! I actually love it. That allows the process to stop and be killed after a segment of trades. So, for example, the checker could run for one hour (or check say 1000 trades) then it will "stop" and kill process and restart, picking up where it left off, combining any primary errors it finds during each check into one file, to do what you mentioned below. (take no action, run a re-check, then take action as needed).
| Quote: | | The "reverify" feature you are requesting can't be made exactly like you are requesting. When you are saying it takes more than 12 hours for the checker to run, you don't expect to sit on the pc and wait 2-3 hours (probably) for the reverify to finish, do you? No to mention your browser will cut you out.. best for such long processes is a cronjob.. Also it is unwise to have it disable trades first and after that if they prove otherwiser to reenable them again.. Also what happens if you are on a holiday and can't manually run the reverify? |
I totally agree with you and for clarity, the 12 hour link check (that died because MySQL went away) was when I had the Smart Checker ON.
| Quote: | | What could be done is for me to make an option "use reverify of report" and when that option is enabled the first time the script runs will save a temp report with the bad trades and no action will be taken at that time, when it completes it starts again to recheck just these bad trades.. when the trade is again bad, then action is taken.. if the trade proves to be good nothing is done.. So at the end on first run it gets the bad ones, on second run rechecks to make sure they are bad and then do the necessary action and emailing.. |
This is exactly what we would love to have. You'd be damn near a saviour if you could make this, and quickly. |
|
|
|
|
|
|
|
Atanasis
Owner
Joined: 22 May 2004
Posts: 4284
Location: The Net
|
|
|
|
|
|
|
| Posted: Wed Aug 17, 2011 3:40 pm Post subject: |
|
|
|
|
|
|
|
|
|
|
check your pm's...
_________________
Thanks,
Kaktusan
|
|
|
|
|
|
|
|
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
|
Powered by phpBB © 2001, 2002 phpBB Group
|
 |
|
 |
| |
