Loading Data From Oracle To Hive By ODI 12c
2018-03-19 15:05
302 查看
本文描述如何通过ODI将Oracle表数据同步到Hive。
1、准备工作
在hadoop集群的各个节点分别安装Oracle Big Data Connectors,具体的组件如下图所示:
这里只需安装Oracle Loader For Hadoop(oraloader)以及Oracle SQL Connector for Hadoop Distributed File System (oraosch)两个软件。安装比较简单,直接解压即可使用(这里的ODI、oraosch以及oraloader组件都是以oracle用户身份安装的。)
2、创建目标表
在Hive上创建目标表,如下:
CREATE TABLE `RHNPACKAGE2`( `id` bigint, `org_id` bigint, `name_id` bigint, `evr_id` bigint, `package_arch_id` bigint, `package_group` bigint, `rpm_version` string, `description` string, `summary` string, `package_size` bigint, `payload_size` bigint, `installed_size` bigint, `build_host` string, `build_time` timestamp, `source_rpm_id` bigint, `checksum_id` bigint, `vendor` string, `payload_format` string, `compat` bigint, `path` string, `header_sig` string, `copyright` string, `cookie` string, `last_modified` timestamp, `created` timestamp, `header_start` bigint, `header_end` bigint, `modified` timestamp);
3、创建映射
之前已经创建好oracle和hive模型,这里直接使用其创建映射。如下图所示:
Integration Type设置属性:
连接设置属性:
过滤设置属性:
LKM设置属性:
IKM设置属性:
如果设置TRUNCATE的值为True,每次导入之前,会把表里的数据清空再导入,默认为false。
4、执行映射
结果如下图:
相关文章推荐
- Loading Data Into Hive From File By ODI 12c
- Loading Data From File To Table By ODI 12c
- SQOOP Load Data from Oracle to Hive Table
- 使用OGG"Loading data from file to Replicat"的方法应该注意的问题:replicat进程是前台进程
- How to remove Oracle Database from your computer---By Roger Gong
- How to remove Oracle Database from your computer---By Roger Gong
- Moving Data from HDFS to Hive Using an External Table
- Import data from EXCEL to Oracle table with PL/SQL Developer
- Oracle:How to create physical standby database with 11g RMAN DUPLICATE FROM ACTIVE DATABASE [ID 747250.1]
- How to remove Oracle Database from your computer---By Roger Gong
- 【Oracle Database 12c New Feature】How to Learn Oracle (12c New Feature) from Error
- How to remove Oracle Database from your computer---By Roger Gong
- How to remove Oracle Database from your computer---By Roger Gong
- 使用OGG"Loading data from file to Replicat"的方法应该注意的问题:replicat进程是前台进程
- Export data to text mode from oracle db
- [转]SSIS error DTS_E_CANNOTACQUIRECONNECTIONFROMCONNECTIONMANAGER when connecting to Oracle data source
- 102.You want to import schema objects of the HR user using Oracle Data Pump from the development dat
- "Unable to get image data from canvas because the canvas has been tainted by cross-origin data"问题产生原因及解决办法
- 拣点芝麻:dbcp (Oracle)重新链接的问题 - Cause: java.sql.SQLException: No more data to read from socket
- [Project] Simulate HTTP Post Request to obtain data from Web Page by using Python Scrapy Framework