I’ve received certain questions over msg-system and email several times:
- Will Dupenet affiliate with some other site (torrents etc.) against some stuff or for free. Answer: no.
- Can you improve the JavaScript performance (NFO-viewer mostly): Answer: no. Get faster PC or use some other service
- Will you add search by date function. Answer: Perhaps later
- Will you add RSS feeds. Answer: No
I wrote email to persons who requested information about new developments. It is about temporary solution that some of you may want to use.
Server OS is now being re-installed. pre-site will be back asap.
My server ISP is having some network problem. Once they have solved it, I’ll refill the missed releases. Stay tuned.
Update: network problem should be now corrected. Site will be back once i have refilled the missed releases.
Every now and then I have to re-build Sphinx-search indexes. During this time (10-20 mins) site will not be available. Sphinx is great and fast, but when I do changes to old records – like removals and updates – Sphinx will not notice those and search may give wrong results.
Thanks for all the feedback. Ill try to check all comments and do bug-checking asap.
I analyzed the logs from previous ~30 days and noticed many IP’s that are hammering or leeching the site. This had negative impact on performance and on bandwith. So I had to implement anti-hammering which will force excessive usage bots (or users) to take a break. The break will be longer if the behaviour continues. I didn’t implement banning, but I will if this hammering doesn’t stop. I will ban some bots manually based on behavior.
I don’t want to cause any problems to normal usage. Pls let me know if this anti-hammering causes problems to you. These bots are leeching 60% more data than regular users daily and affects overall performance. I will set more relaxed timers once these bots are gone.
Edit: first winner is a box from Germany. Banned for ever for trying to read the index every second.
Edit2: second winner is a shared hosting box from USA. Banned for trying to leech all nfo-images in numerical order.
Edit3: one innocent looking .eu server just didn’t get it after 45 leech warnings. Obviously this is a bot leeching data without human control. Server is now banned for leeching the TV-sections.
Some bots are still close to the ban-limit. Why would anyone need the RSS-feed or site index data every 30 seconds 24/7? Data does not change that often. 3-5 minutes interval should be fine. I have checked that these are prolly bots: they are all web-servers with static IPs accessing data at regular intervals. After ~45 leech warnings I will need to take action.
I’m doing some necessary maintenance upgrades. Pre-site will be back asap.
Update 12 hours later: the box won’t reboot after system upgrade. I have found people suffering from the same problem: something weird happened with latest Ubuntu 10.04 update. This is most likely related to video driver/splash screen which I wouldn’t need anyways. It just won’t continue to the actual boot sequence with any kernel-image… Pls be patient.
All this started with moving the genre-field around. When I turned it into a icon, quite many people got upset. Especially those browsing sections like mp3. So I decided to introduce a client-side cookie based search settings for genre and initial section selector.
Cookie is set to expire in 30 days. Re-saving might be necessary.
Section selector doesn’t limit free-text search to that section. I could do that, but so can you: just type the section together with your query. E.g. “red mp3″ would search word “red” in mp3-section.
I also modified the section switcher so that it works with or without JavaScript. If your browser doesn’t allow scripts, you will see a “Select”-button.
Pls give feedback.
I noticed some problems with default Apache configuration. Logs showed that web server choked during peak times. I’ve been tuning the following parameters: MaxClients, ServerLimit, MinSpareServers and MaxSpareServers.
Setting MaxClients and Serverlimit too high (500) caused SIGHUP’s and Apache2 restarts. Now I’m trying with 300. I should find some time to monitor and analyse the logs properly and find reliable way to calculate MaxClients. There are quite many articles available.
Please let me know if you have problems accessing the site. If possible, record also the time and time zone.
If you don’t want to see your comment in public, just mark it as personal or private. I will read all comments, but I don’t have to publish everything 