您的位置:首页 > 运维架构 > Apache

使用apache drill的一些问题

2014-03-24 15:33 253 查看
1、在hive中生成的parquet,在drill中用不了,报错

2、在drill中查询太大的(例如13M以上)的json文件,就报错:

WARN util.ResourceLeakDetector: LEAK: ByteBuf was GC'd before being released correctly.  The following stack trace shows where the leaked object was created, rather than where you failed to release it.

io.netty.util.ResourceLeakException: io.netty.buffer.PooledUnsafeDirectByteBufL@1f830e0

        at io.netty.util.ResourceLeakDetector$DefaultResourceLeak.<init>(ResourceLeakDetector.java:174)

        at io.netty.util.ResourceLeakDetector.open(ResourceLeakDetector.java:116)

        at io.netty.buffer.PooledByteBufL.<init>(PooledByteBufL.java:45)

        at io.netty.buffer.PooledUnsafeDirectByteBufL.<init>(PooledUnsafeDirectByteBufL.java:53)

        at io.netty.buffer.PooledUnsafeDirectByteBufL.<init>(PooledUnsafeDirectByteBufL.java:32)

        at io.netty.buffer.PooledUnsafeDirectByteBufL$1.newObject(PooledUnsafeDirectByteBufL.java:39)

        at io.netty.buffer.PooledUnsafeDirectByteBufL$1.newObject(PooledUnsafeDirectByteBufL.java:36)

        at io.netty.util.Recycler.get(Recycler.java:40)

        at io.netty.buffer.PooledUnsafeDirectByteBufL.newInstance(PooledUnsafeDirectByteBufL.java:44)

        at io.netty.buffer.PoolArenaL$DirectArena.newByteBuf(PoolArenaL.java:397)

        at io.netty.buffer.PoolArenaL.allocate(PoolArenaL.java:93)

        at io.netty.buffer.PooledByteBufAllocatorL.newDirectBuffer(PooledByteBufAllocatorL.java:235)

        at io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:132)

        at io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:123)

        at org.apache.drill.exec.memory.DirectBufferAllocator.buffer(DirectBufferAllocator.java:35)

        at org.apache.drill.exec.vector.BitVector.allocateNew(BitVector.java:53)

        at org.apache.drill.exec.vector.NullableIntVector.allocateNew(NullableIntVector.java:119)

        at org.apache.drill.exec.vector.AllocationHelper.allocate(AllocationHelper.java:12)

        at org.apache.drill.exec.store.VectorHolder.allocateNew(VectorHolder.java:87)

        at org.apache.drill.exec.store.VectorHolder.reset(VectorHolder.java:74)

        at org.apache.drill.exec.store.json.JSONRecordReader.resetBatch(JSONRecordReader.java:161)

        at org.apache.drill.exec.store.json.JSONRecordReader.next(JSONRecordReader.java:117)

        at org.apache.drill.exec.physical.impl.ScanBatch.next(ScanBatch.java:95)

        at org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.next(ScreenCreator.java:77)

        at org.apache.drill.exec.work.FragmentRunner.run(FragmentRunner.java:79)

        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)

        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)

        at java.lang.Thread.run(Thread.java:744)

暂时放弃使用drill了,试试impala去。。。
内容来自用户分享和网络整理,不保证内容的准确性,如有侵权内容,可联系管理员处理 点击这里给我发消息
标签:  drill