org.apache.spark.sql.AnalysisException: Try to map struct<>to Tuple1 异常
2017-10-01 21:34
4507 查看
spark.read.parquet(mypath).as[MyEntity]会遇到下面异常
org.apache.spark.sql.AnalysisException: Try to map struct<uid:string> to Tuple1, but failed as the number of fields does not line up.; at org.apache.spark.sql.catalyst.analysis.Analyzer$ResolveDeserializer$.org$apache$spark$sql$catalyst$analysis$Analyzer$ResolveDeserializer$$fail(Analyzer.scala:2044) at org.apache.spark.sql.catalyst.analysis.Analyzer$ResolveDeserializer$.org$apache$spark$sql$catalyst$analysis$Analyzer$ResolveDeserializer$$validateTopLevelTupleFields(Analyzer.scala:2061) at org.apache.spark.sql.catalyst.analysis.Analyzer$ResolveDeserializer$$anonfun$apply$32$$anonfun$applyOrElse$12.applyOrElse(Analyzer.scala:2035) at org.apache.spark.sql.catalyst.analysis.Analyzer$ResolveDeserializer$$anonfun$apply$32$$anonfun$applyOrElse$12.applyOrElse(Analyzer.scala:2027)
在read之前需要：
import spark.implicits._
内容来自用户分享和网络整理，不保证内容的准确性，如有侵权内容，可联系管理员处理 
相关文章推荐
- spark关于join后有重复列的问题（org.apache.spark.sql.AnalysisException: Reference '*' is ambiguous）
- org.apache.spark.shuffle.FetchFailedException:Failed to connect to异常
- [置顶] Sparksql 一个错误：org.apache.spark.sql.AnalysisException: character ' ' not supported here;
- org.apache.spark.sql.AnalysisException: Table or view not found: `traintext`.`train`; line 1 pos 14;
- org.apache.lucene.queryParser.ParseException: Encountered "<EOF>" at line 1, column 0.
- org.hibernate.ObjectDeletedException: deleted instance passed to merge: [xxx#<null>]
- mybatis中的一个异常：org.apache.ibatis.exceptions.TooManyResultsException: Expected one result (or null) to
- 异常:java.lang.ClassNotFoundException: org.apache.commons.collections.map.ListOrderedMap
- 异常-----springmvc + ajaxfileupload解决ajax不能异步上传图片的问题。java.lang.ClassCastException: org.apache.catalina.connector.RequestFacade cannot be cast to org.springframework.web.multipart.
- 异常：Caused by: org.apache.tomcat.dbcp.dbcp.SQLNestedException: Cannot create JDBC driver of class '' for connect URL 'null'--解决方法
- Spark运行程序异常信息： org.apache.spark.SparkException: Task not serializable 解决办法
- Spring 整合 Flex （BlazeDS）无法从as对象 到 Java对象转换的异常：org.springframework.beans.ConversionNotSupportedException: Failed to convert property value of type 'java.util.Date' to required type 'java.sql.Timestamp' for property 'wfsj'; nested exception is java.lang.Ill
- A master URL must be set in your configuration at org.apache.spark.SparkContext.<init>(SparkContext.
- Unable to load class [ org.zh.domain] declared in Hibernate configuration <mapping/> entry,异常解决方案
- org.apache.tomcat.dbcp.dbcp.SQLNestedException: Cannot get a connection, pool error Timeout waiting for idle object异常原因
- Oracle版本:12c 出现的异常:org.apache.tomcat.dbcp.dbcp.SQLNestedException: Cannot create PoolableConnectionF
- org.hibernate.MappingException: An AnnotationConfiguration instance is required to use <mapping class="Bbs"/>
- org.apache.catalina.LifecycleException: Failed to start component 异常
- org.apache.lucene.queryParser.ParseException: Encountered "<EOF>" at line 1, column 0.
- tomcat应用org.apache.catalina.LifecycleException: Failed to stop component [StandardEngine[Catalina].StandardHost[localhost].StandardContext[]]异常的根本原因