<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
		>
<channel>
	<title>Comments on: AMO Scalability: Then and Now</title>
	<atom:link href="http://micropipes.com/blog/2008/04/18/amo-scalability-then-and-now/feed/" rel="self" type="application/rss+xml" />
	<link>http://micropipes.com/blog/2008/04/18/amo-scalability-then-and-now/</link>
	<description>because at 3am anything sounds good</description>
	<lastBuildDate>Tue, 31 Jan 2012 16:27:56 +0000</lastBuildDate>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>http://wordpress.org/?v=3.1.4</generator>
	<item>
		<title>By: All Night Diner : Caching is easy; Expiration is hard</title>
		<link>http://micropipes.com/blog/2008/04/18/amo-scalability-then-and-now/comment-page-1/#comment-2799</link>
		<dc:creator>All Night Diner : Caching is easy; Expiration is hard</dc:creator>
		<pubDate>Wed, 23 Apr 2008 16:36:05 +0000</pubDate>
		<guid isPermaLink="false">http://micropipes.com/blog/2008/04/18/amo-scalability-then-and-now/#comment-2799</guid>
		<description>[...] on a high from our success with memcached in AMO version 2, we decided to go a fairly common route and cache query results in version 3. This [...]</description>
		<content:encoded><![CDATA[<p>[...] on a high from our success with memcached in AMO version 2, we decided to go a fairly common route and cache query results in version 3. This [...]</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Dave Miller</title>
		<link>http://micropipes.com/blog/2008/04/18/amo-scalability-then-and-now/comment-page-1/#comment-2727</link>
		<dc:creator>Dave Miller</dc:creator>
		<pubDate>Tue, 22 Apr 2008 03:44:50 +0000</pubDate>
		<guid isPermaLink="false">http://micropipes.com/blog/2008/04/18/amo-scalability-then-and-now/#comment-2727</guid>
		<description>Also in that history was a pair and then a triplet of Squid proxies pointing at a single back-end box, followed by a triplet of Apache+mod_proxy+mod_cache proxies sitting in front of that same box, followed by 4 webservers behind an LVS load balancer with each of those proxying the /developer/ subdirectory back to that original single box, before we had the Netscaler.</description>
		<content:encoded><![CDATA[<p>Also in that history was a pair and then a triplet of Squid proxies pointing at a single back-end box, followed by a triplet of Apache+mod_proxy+mod_cache proxies sitting in front of that same box, followed by 4 webservers behind an LVS load balancer with each of those proxying the /developer/ subdirectory back to that original single box, before we had the Netscaler.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Wil Clouser</title>
		<link>http://micropipes.com/blog/2008/04/18/amo-scalability-then-and-now/comment-page-1/#comment-2712</link>
		<dc:creator>Wil Clouser</dc:creator>
		<pubDate>Mon, 21 Apr 2008 17:27:24 +0000</pubDate>
		<guid isPermaLink="false">http://micropipes.com/blog/2008/04/18/amo-scalability-then-and-now/#comment-2712</guid>
		<description>&lt;blockquote&gt;125M hits/day is approximately 1500 hits/second on average, but more interesting, what is the maximum? And are those “hits” or “page views” (i.e. does it include images and other resources)?&lt;/blockquote&gt;
Those are hits (including images and other resources), so it&#039;s probably not a particularly good stat since our redesign added a lot of images, etc.  On the other hand, we&#039;ve also unloaded update checks to another server, so those shouldn&#039;t be counted anymore.  As far as maximum, it&#039;s close to 200M right now.  

The better statistic, page views, is around 5-7M/day.  This has been pretty volatile lately (probably due to the redesign) but it looks fairly consistent averaged over the past few months.

&lt;blockquote&gt;
 And how many of the page views can’t just be flat files served by lighttpd (i.e. all public and most of the private it seems, cause the only real difference from the public pages are the first name shown — which could just be added by javascript from a cookie or from a json-request with a long cache time and a cache-killer in a cookie)? Just curious.&lt;/blockquote&gt;
Plenty of it could be, but I suspect the netscaler offers as good if not better performance than lighttpd (&lt;-- totally unresearched claim! :) ).  One of our obvious-in-hindsight mistakes was storing add-on preview images in the database.  I think it started with the idea of just storing icons in the db (max 32x32) which wouldn&#039;t be bad.  Then it somehow encompassed add-on preview images, which can be much larger, and it&#039;s slowing our queries down.  A pretty bad idea, and I think it would be a perf boost to store those on disk instead of the db.

Also, regarding the javascript idea - that&#039;s actually what we did in version 2.  In v3 there are more changes than just name - the menu changes depending on whether you are a developer, admin, localizer, etc. and there are some &quot;edit&quot; buttons if you have permission to things.  Certainly possible with js, but more to think about.

&lt;blockquote&gt;
I don’t know if you changed it, but last time there was talk about AMO design, it seemed like you didn’t use the most optimize schema for the translations (i.e. one general translations table, instead of a translations table for each table with data for the fields on columns instead of rows). Also, what about pre-generating translated php-files.&lt;/blockquote&gt;
Like the images above, we haven&#039;t really altered the db schema much even if we should.  It&#039;ll probably be targeted for another update (the next one being far less visual and more backend).</description>
		<content:encoded><![CDATA[<blockquote><p>125M hits/day is approximately 1500 hits/second on average, but more interesting, what is the maximum? And are those “hits” or “page views” (i.e. does it include images and other resources)?</p></blockquote>
<p>Those are hits (including images and other resources), so it&#8217;s probably not a particularly good stat since our redesign added a lot of images, etc.  On the other hand, we&#8217;ve also unloaded update checks to another server, so those shouldn&#8217;t be counted anymore.  As far as maximum, it&#8217;s close to 200M right now.  </p>
<p>The better statistic, page views, is around 5-7M/day.  This has been pretty volatile lately (probably due to the redesign) but it looks fairly consistent averaged over the past few months.</p>
<blockquote><p>
 And how many of the page views can’t just be flat files served by lighttpd (i.e. all public and most of the private it seems, cause the only real difference from the public pages are the first name shown — which could just be added by javascript from a cookie or from a json-request with a long cache time and a cache-killer in a cookie)? Just curious.</p></blockquote>
<p>Plenty of it could be, but I suspect the netscaler offers as good if not better performance than lighttpd (< -- totally unresearched claim! <img src='http://micropipes.com/blog/wp-includes/images/smilies/icon_smile.gif' alt=':)' class='wp-smiley' />  ).  One of our obvious-in-hindsight mistakes was storing add-on preview images in the database.  I think it started with the idea of just storing icons in the db (max 32x32) which wouldn't be bad.  Then it somehow encompassed add-on preview images, which can be much larger, and it's slowing our queries down.  A pretty bad idea, and I think it would be a perf boost to store those on disk instead of the db.</p>
<p>Also, regarding the javascript idea - that's actually what we did in version 2.  In v3 there are more changes than just name - the menu changes depending on whether you are a developer, admin, localizer, etc. and there are some "edit" buttons if you have permission to things.  Certainly possible with js, but more to think about.</p>
<blockquote><p>
I don’t know if you changed it, but last time there was talk about AMO design, it seemed like you didn’t use the most optimize schema for the translations (i.e. one general translations table, instead of a translations table for each table with data for the fields on columns instead of rows). Also, what about pre-generating translated php-files.</p></blockquote>
<p>Like the images above, we haven&#8217;t really altered the db schema much even if we should.  It&#8217;ll probably be targeted for another update (the next one being far less visual and more backend).</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: AndersH</title>
		<link>http://micropipes.com/blog/2008/04/18/amo-scalability-then-and-now/comment-page-1/#comment-2705</link>
		<dc:creator>AndersH</dc:creator>
		<pubDate>Mon, 21 Apr 2008 11:33:05 +0000</pubDate>
		<guid isPermaLink="false">http://micropipes.com/blog/2008/04/18/amo-scalability-then-and-now/#comment-2705</guid>
		<description>125M hits/day is approximately 1500 hits/second on average, but more interesting, what is the maximum? And are those &quot;hits&quot; or &quot;page views&quot; (i.e. does it include images and other resources)? And how many of the page views can&#039;t just be flat files served by lighttpd (i.e. all public and most of the private it seems, cause the only real difference from the public pages are the first name shown -- which could just be added by javascript from a cookie or from a json-request with a long cache time and a cache-killer in a cookie)? Just curious.

I don&#039;t know if you changed it, but last time there was talk about amo design, it seemed like you didn&#039;t use the most optimize schema for the translations (i.e. one general translations table, instead of a translations table for each table with data for the fields on columns instead of rows). Also, what about pre-generating translated php-files.</description>
		<content:encoded><![CDATA[<p>125M hits/day is approximately 1500 hits/second on average, but more interesting, what is the maximum? And are those &#8220;hits&#8221; or &#8220;page views&#8221; (i.e. does it include images and other resources)? And how many of the page views can&#8217;t just be flat files served by lighttpd (i.e. all public and most of the private it seems, cause the only real difference from the public pages are the first name shown &#8212; which could just be added by javascript from a cookie or from a json-request with a long cache time and a cache-killer in a cookie)? Just curious.</p>
<p>I don&#8217;t know if you changed it, but last time there was talk about amo design, it seemed like you didn&#8217;t use the most optimize schema for the translations (i.e. one general translations table, instead of a translations table for each table with data for the fields on columns instead of rows). Also, what about pre-generating translated php-files.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Wil Clouser</title>
		<link>http://micropipes.com/blog/2008/04/18/amo-scalability-then-and-now/comment-page-1/#comment-2625</link>
		<dc:creator>Wil Clouser</dc:creator>
		<pubDate>Fri, 18 Apr 2008 22:14:34 +0000</pubDate>
		<guid isPermaLink="false">http://micropipes.com/blog/2008/04/18/amo-scalability-then-and-now/#comment-2625</guid>
		<description>&lt;blockquote&gt;Just curious, how is this charted against the usage growth of AMO?&lt;/blockquote&gt;

We started using urchin on AMO about this time last year so I don&#039;t have numbers from before that without time consuming log crunching.  I can tell you we&#039;re averaging 125M hits per day right now, and a year ago it was 50M.</description>
		<content:encoded><![CDATA[<blockquote><p>Just curious, how is this charted against the usage growth of AMO?</p></blockquote>
<p>We started using urchin on AMO about this time last year so I don&#8217;t have numbers from before that without time consuming log crunching.  I can tell you we&#8217;re averaging 125M hits per day right now, and a year ago it was 50M.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Seamus</title>
		<link>http://micropipes.com/blog/2008/04/18/amo-scalability-then-and-now/comment-page-1/#comment-2616</link>
		<dc:creator>Seamus</dc:creator>
		<pubDate>Fri, 18 Apr 2008 15:49:22 +0000</pubDate>
		<guid isPermaLink="false">http://micropipes.com/blog/2008/04/18/amo-scalability-then-and-now/#comment-2616</guid>
		<description>Just curious, how is this charted against the usage growth of AMO?</description>
		<content:encoded><![CDATA[<p>Just curious, how is this charted against the usage growth of AMO?</p>
]]></content:encoded>
	</item>
</channel>
</rss>

