hadoop&spark mapreduce对比 & 框架设计和理解
2015-11-25 20:34
381 查看
Hadoop MapReduce:
MapReduce在每次执行的时候都要从磁盘读数据,计算完毕后都要把数据放到磁盘
spark map reduce:
RDD is everything for dev:
Basic Concepts:
Graph RDD:
Spark Runtime:
schedule:
Depency Type:
Scheduler Optimizations:
Event Flow:
Submit Job:
New Job Instance:
Job In Detail:
executor.launchTask:
Standalone:
Work Flow:
Standalone detail:
Driver application to Clustor:
Worker Exception:
Executor Exception:
Master Exception:
Master HA:
MapReduce在每次执行的时候都要从磁盘读数据,计算完毕后都要把数据放到磁盘
spark map reduce:
RDD is everything for dev:
Basic Concepts:
Graph RDD:
Spark Runtime:
schedule:
Depency Type:
Scheduler Optimizations:
Event Flow:
Submit Job:
New Job Instance:
Job In Detail:
executor.launchTask:
Standalone:
Work Flow:
Standalone detail:
Driver application to Clustor:
Worker Exception:
Executor Exception:
Master Exception:
Master HA:
相关文章推荐
- spark架构设计&编程模型01
- linux下jdk安装 failed /usr/local/jdk1.6.0_10/jre/lib/i386/client/libjvm.so, because /usr/local/jdk1.6.
- 在linux中的virtualbox无法挂载usb设备的解决方法
- linux系统日志
- Linux下静态库与动态库的使用
- Shell—AWK—脚本实例
- OAuth2.0 微博登陆网站功能的实现(一)获取用户授权及令牌 Access Token
- nginx upstream setting
- Linux创建用户、用户组 及 删除
- linux 里 /etc/passwd 、/etc/shadow和/etc/group 文件内容解释
- linux学习笔记之用户切换
- linux学习(二)如何学习linux
- 你不知道的shell用法和脚本,简单&强大
- Linux学习笔记之Makefile多个c文件的编写
- OpenJudge_P1746 子串(KMP)
- linux文件权限chmod
- linux中shell常用联合批量操作命令
- Linux 学习笔记之Makefile单个c文件的编写
- log4j的用法(For Windows/linux/纯java应用/web应用) logback 的用法在evernote里面
- 多线程 (NSThread NSOperation GCD)