Free Republic
Browse · Search
News/Activism
Topics · Post Article

To: Utmost Certainty
FR doesn't have much static content, so using a content distribution network (like Cloudflare or Akamai) won't really help.

What FR really needs is a clustered database, that automatically replicates data across servers. Alternatively, use of a distributed cache like memcache would probably make a big difference. It's how large sites like Facebook, Wikipedia, YouTube, Reddit, and other similar websites handle large amounts of dynamic data.

There's no simple solution. Faster servers can help, but you run into other limiting factors if the application can't handle high levels of concurrency.

40 posted on 10/11/2012 9:02:10 PM PDT by justlurking (The only remedy for a bad guy with a gun is a good WOMAN (Sgt. Kimberly Munley) with a gun)
[ Post Reply | Private Reply | To 19 | View Replies ]


To: justlurking
Alternatively, use of a distributed cache like memcache would probably make a big difference.

Indeed, all user authentication data and the most recent week of posts would probably fit easily in a few gigabytes of RAM. The challenge is how to architect access to it.

46 posted on 10/11/2012 9:23:34 PM PDT by HiTech RedNeck (let me ABOs run loose, lew (or is that lou?))
[ Post Reply | Private Reply | To 40 | View Replies ]

To: justlurking
I agree with you that akamai/cloudflare aren't the right kinds of solutions, but once a page of posts fills out (gets to 50), it is static. It doesn't change, doesn't look different depending on who is viewing it. The pages here are great candidates for caching.

You are right that DB clusters and memcache would work. Even simple filesystem caching would probably work. A reverse proxy cache like Varnish would probably take some of the heat off.

59 posted on 10/11/2012 10:01:35 PM PDT by Wayne07
[ Post Reply | Private Reply | To 40 | View Replies ]

To: justlurking

Ah, you make good points.

How well does memcache work with Perl? At least that’s what script lang this site is largely written in AFAIK.

I’d also wonder if Perl is more server-intensive than something like PHP.


80 posted on 10/11/2012 10:35:05 PM PDT by Utmost Certainty (Our Enemy, the State)
[ Post Reply | Private Reply | To 40 | View Replies ]

Free Republic
Browse · Search
News/Activism
Topics · Post Article


FreeRepublic, LLC, PO BOX 9771, FRESNO, CA 93794
FreeRepublic.com is powered by software copyright 2000-2008 John Robinson