首页 > 其他 > 详细

Storm的一些重要的bug issues

时间:2015-05-25 16:34:27      阅读:167      评论:0      收藏:0      [点我收藏+]
Fix cascading Storm failure by improving reconnection strategy and buffering messages

上面的isusse是storm从0.9.3升级到0.9.4主要的优化,去掉了0.9.3中对于worker之间通信的bug。0.9.3对于worker之间如果连接不上就直接throw一个exception出来,导致该worker crash,那么和该worker 连接的worker也有可能在连接超时时crash,从而导致worker级联crash,job无法正常工作,数据丢失。

0.9.4改进的是不抛出异常,直接丢弃message,等待刷新重连,具体讨论可见该issue

Make worker receiver thread number configurable


技术分享
Nathan Marz
 added a comment - 04/Apr/14 01:28
It would be a good experiment, but we‘d have to make sure that incoming messages from the same task always go to the same receiver thread (otherwise messages sent by a task to another task could be received out of order)

Storm Performance cannot be scaled up by adding more CPU cores
https://github.com/apache/storm/pull/103

Storm的一些重要的bug issues

原文:http://blog.csdn.net/wzhg0508/article/details/45970369

(0)
(0)
   
举报
评论 一句话评论(0
关于我们 - 联系我们 - 留言反馈 - 联系我们:wmxa8@hotmail.com
© 2014 bubuko.com 版权所有
打开技术之扣,分享程序人生!