您的位置:首页 > 其它

hive 不同用户 权限设置 出错处理

2017-11-24 09:49 330 查看
今天安装了hive

在a账号安装的,一切正常

但是到其他账户下,报错

>show tables;

Error in metadata: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient

FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask

以为是权限问题

查看log

Nested Throwables StackTrace:

org.apache.commons.dbcp.SQLNestedException: Cannot get a connection, pool error Could not create a validated object, cause: A read-only user or a user in a read-only database is not permitted to disable read-only mode on a connection.

后来的解决方案:一个老外的方案:

I had the same issue and resolved it by the following way. The issue is because of two possible reasons.
Either, the user you logged in as (do 'whoami' ) does not havewrite access to the derby metastore database directory used by Hive.So, go to /var/lib/hive/metastore/metastore_db
(this is the defaultin most cases) and verify if your user id has permissions by doing anls. In case your userid does not have permissions, you should ask the owner of the directory to grant write permissions to you. So,login as the owner/the
super user and execute

cd /var/lib/hive/metastore/metastore_db

chmod a+rwx . --recursive

Be warned that this will give permissions to all users. Tweak r-w-x bits accordingly though.
The other possible reason is that derby is a single user database. So, please clear the lock files by going to

cd /var/lib/hive/metastore/metastore_db

rm *.lck

(第二天)今天执行 count(1)的时候报错

        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)

        at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)

        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)

        at java.lang.reflect.Constructor.newInstance(Constructor.java:525)

        at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:90)

        at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:57)

        at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:1534)

        at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:803)

        at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1332)

        at org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:109)

        at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:952)

        at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:946)

        at java.security.AccessController.doPrivileged(Native Method)

        at javax.security.auth.Subject.doAs(Subject.java:415)

        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)

        at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:946)

        at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:920)

        at org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:447)

        at org.apache.hadoop.hive.ql.exec.MapRedTask.execute(MapRedTask.java:136)

        at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:138)

        at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57)

        at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1352)

        at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1138)

        at org.apache.hadoop.hive.ql.Driver.run(Driver.java:951)

        at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:259)

        at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:216)

        at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:412)

        at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:755)

        at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:613)

        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)

        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

        at java.lang.reflect.Method.invoke(Method.java:601)

        at org.apache.hadoop.util.RunJar.main(RunJar.java:208)

Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.AccessControlException): Permission denied: user=shen, access=EXECUTE, inode="/tmp/hadoop-mapred/mapred/staging"

        原来还有一个文件要设置权限

        解决方法:

            hadoop fs -chmod 777  /tmp/hadoop-mapred/mapred/staging  
内容来自用户分享和网络整理,不保证内容的准确性,如有侵权内容,可联系管理员处理 点击这里给我发消息
标签: