big data vs HPC
2015-12-16 13:38
120 查看
When I tried some SIMD optimization in large-scale simulation(HPC), it is so difficult to implment. Since there is no easy way to change the simulatoin logic to use e.g. matrix blocking, and go to finer-gratunity, BLAS or simlar math libs is already high-performance.
For example, same idea here, use cache and do map-reduce. While the algorithm logic is to avoid cached large matrix on each core, also we need synchronization on every iteration due to algorithm logic, which makes map-reduce painful.
I suppose there maybe two issues: either HPC algorithm design should at first considering scalabity like big data apps, which lead the components can be easy distributed, or big data is big data, but simple processing logic.
For example, same idea here, use cache and do map-reduce. While the algorithm logic is to avoid cached large matrix on each core, also we need synchronization on every iteration due to algorithm logic, which makes map-reduce painful.
I suppose there maybe two issues: either HPC algorithm design should at first considering scalabity like big data apps, which lead the components can be easy distributed, or big data is big data, but simple processing logic.
相关文章推荐
- 黑马程序员——IO流
- str 绑定值的结尾 null 字符缺失(oracle数据库通过pde恢复,容易出现该错误)
- 谈语法
- 使用Python抓取google街景照片
- Thymeleaf中的context对象-原标题:Context Objects in Thymeleaf
- Java设计模式——策略模式
- Java设计模式——策略模式
- JS与C#编码解码
- 使用automake编译程序
- shell中的exec命令
- 解密“设计模式”
- Objective-C语言_便利初始化函数和便利构造器
- jquery中监控input文本框值的变化触发函数
- 十六进制转十进制
- Implementing the skip list data structure
- Dubbo与Zookeeper、SpringMVC整合和使用(负载均衡、容错)
- TextView排版混乱或自动换行
- cocos2d-lua里 如何绑定按钮button的点击事件click
- android view的宽高通过代码进行设置---dp和sp之间互转
- BitMap优化