A nice blog post from Asana on How to Start Small and Scale Over Time:
Recently, we’ve made a series of changes to our data infrastructure that have all proven extremely valuable:
- Investing in monitoring, testing, and automation to reduce fire-fighting
- Moving from MySQL to Redshift for a scalable data warehouse
- Moving from local log processing to Hadoop for scalable log processing
- Introducing Business Intelligence tools to allow non-experts to answer their own data questions
Got this from Hadoop Weekly, Issue #95, 9 November 2014. It has many other valuable articles on scaling.