下面为技术列表
python |
scala |
aws |
openstack |
docker |
LXC |
libcloud |
mesos |
ec2 |
s3 |
dynamodb |
sqs |
mongodb |
cassandra |
zookeeper |
kafka |
memcache |
statsD |
python:用于写非常多脚本工具
scala:写非常多服务应用,相比java而言简洁太多
aws: Amazon web service亚马逊网络服务,不必多说
openstack:云计算软件 https://www.openstack.org/ 大公司将程序从aws转移到openstack上以降低开支增强控制貌似已经是一个趋势了
docker: 一种程序容器,打算近期试试用docker来deploy下程序。Docker is an open-source
engine that automates the deployment of any application as a lightweight, portable, self-sufficient container that will run virtually anywhere.
LXC: 同docker一样都是一种linux container,能用于deploy程序
libcloud:apache家的,是一个python的库,提供用于和云服务相关的接口。
mesos: 也是apache家的,官网宣称:“Making it easy to build resource-efficient distributed systems“
Apache Mesos is a cluster manager that provides efficient resource isolation and sharing across distributed applications, or frameworks. It can run
Hadoop, Jenkins, Spark, Aurora, and other applications on a dynamically shared pool of nodes. 前段时间还看到报道说spark大有替代hadoop之趋势,由于有比编写mapreduce好非常多的并行计算方式。
ec2: Amazon Elastic Compute Cloud, aws核心服务之中的一个,用户可使用亚马逊提供的“虚拟机器”来跑自己的程序
S3:Amazon simple storage service. 又是aws核心服务之中的一个,用于云存储
DynamoDB:aws服务,提供NoSQL数据库服务
SQS:Amazon simple queue service. 用于发送信息,比方用aws跑程序时传递指令,还能够用SNS(simple notification service)发送通知
mongodb:一种非常普遍的开源的NoSQL数据库
cassandra:一种apache的数据库,应用很广,twitter,github,ebay,godaddy,instagram等都在用
zookeeper:apache的一个开源项目,用于开发维护开源的server,提供分布式同步服务等
kafka:apache家。分布式传送消息。Apache Kafka is publish-subscribe messaging rethought as a distributed commit log.
memcache:a distributed memory object caching system. 分布式内存缓存系统。
statsD: A network daemon that runs on the Node.js platform and listens for statistics, like counters
and timers, sent overUDP and sends aggregates to one or more pluggable backend services (e.g., Graphite).
专门用于NodeJS上听取数据的。
楼主的学习顺序:python,scala,aws,openstack,docker最重要。剩下的了解下大致用途和原理,实际应用时去官网看documents即可。对cassandra和mongodb比較感兴趣,大概也会专门看一看。
相关网络课程:
python: introduction to computer science https://www.udacity.com/course/cs101
python: learn to program https://class.coursera.org/programming1-002
mongodb: data wrangling with mongodb https://www.udacity.com/course/ud032
scala: function programming principles in scala https://class.coursera.org/progfun-004
database: introduction to database https://class.coursera.org/db