Oracle Odi 12c New Features 5h381h
This document was ed by and they confirmed that they have the permission to share it. If you are author or own the copyright of this book, please report to us by using this report form. Report 3i3n4
Overview 26281t
& View Oracle Odi 12c New Features as PDF for free.
More details 6y5l6z
- Words: 1,278
- Pages: 26
Oracle Data Integrator 12c New Features
Joachim Jaensch Principal Sales Consultant
Copyright © 2014 Oracle and/or its s. All rights reserved. |
Safe Harbor Statement The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.
Copyright © 2014 Oracle and/or its s. All rights reserved. |
3
What‘s New In Oracle Data Integrator 12c? • • • • • • • • • • • • •
Declarative Flow-Based Interface Reusable Mappings Multi-Threaded Target Load Step-by-Step Debugger Runtime Performance Enhancement Oracle GoldenGate Integration Improvements Standalone Agent Management with WebLogic Management Framework Integration with Oracle Platform Security Services (OPSS) Enterprise Roles JSON and XML Improvements Oracle Warehouse Builder (OWB) Integration OWB to ODI Migration Tool OEM – Management Pack for Oracle Data Integrator New Mapping Components: PIVOT, UNPIVOT
Copyright © 2014 Oracle and/or its s. All rights reserved. | Oracle OpenWorld 2014
4
Reusable Mappings • Capture common logic (sources, targets, transformations) • Reuse logic in mappings
Copyright © 2014 Oracle and/or its s. All rights reserved. | Oracle OpenWorld 2014
5
Multi-Threaded Target Load Data Server settings:
• Fast Load through parallel JDBC connections • Configurable per Data Server
Parallel Load Threads
JDBC Source
ODI Agent
Copyright © 2014 Oracle and/or its s. All rights reserved. |
Target Database
In-Session Parallelism ODI 11g
• Goal
SrcSet1 SrcSet2
• Allow the execution of tasks and steps in
SrcSet3
parallel rather than sequentially
• How • Introduction of a new Runtime concept: •
Execution Units In 12.1.2 loading of C$ tables can be executed in parallel
Integration
Total Execution Time
ODI 12.1.2 SrcSet1 SrcSet2
Integration
SrcSet3
Total Execution Time
Copyright © 2014 Oracle and/or its s. All rights reserved. | Oracle OpenWorld 2014
7
Low Overhead Session Execution • Goal
• Reduce status and session management overhead
• How
• Cache and reuse a Session Blueprint instead of accessing the ODI repositories • Avoid writing logs in the repository when it is not necessary
• Benefits
• Better performance when executing scenarios multiple times, when restarting a session,
•
when logging sessions activity Less fragmentation of repository tables
Copyright © 2014 Oracle and/or its s. All rights reserved. | Oracle OpenWorld 2014
8
Concurrent Execution Control • You can now limit concurrent executions in a scenario or load plan and force a concurrent execution to either wait or raise an execution error
Copyright © 2014 Oracle and/or its s. All rights reserved. |
Step by Step Debugger • Give control to the on the Execution Flow of a Session • Pause, Resume, Run to next Step, etc.
• Define breakpoints on steps in packages • Toggle breakpoints in Sessions • Query data through agent (gives access to uncommitted data)
• Start a session with the option to wait for inputs on Error
Copyright © 2014 Oracle and/or its s. All rights reserved. |
One-Step Model and Topology Creation
• One dialog to create all metadata objects: • Data Server • Physical and Logical Schema • Context • Model • Simplifies and accelerates ODI development
Copyright © 2014 Oracle and/or its s. All rights reserved. |
Integration Between GoldenGate and ODI 12c
• Enable GoldenGate Journalizing on Interfaces without restructuring.
• Manage GoldenGate Capture/Delivery instances in ODI Topology
• Set common GoldenGate parameters graphically Bulk Load Scenario
Real Time Scenario
• Deploy GoldenGate Processes via ODI • Real-Time and Bulk from the same Interface
Extract
Replicat
Copyright © 2014 Oracle and/or its s. All rights reserved. | Oracle OpenWorld 2014
12
Security Enhancements
• Product-wide standardization on AES encryption • FIPS compliant (US) • AES key 128bit by default, algorithm and key length can be configured: 128, 192 & 256.
• ODI import and export uses secure encryption for sensitive data
Copyright © 2014 Oracle and/or its s. All rights reserved. |
Improved JSON and XML {
• Complex File Driver reads and writes JSON • Conversion to tabular Datastore format • XML for advanced constructs: Datastore CUST • any, anyType, anyAttribute PK_CUST first 1 John • Custom XML column mappings
}
JSON
"first": "John", "last": "Smith", "phone": [ { "type": "home", "number": "212 555-1234" }, { "type": "work", "number": "646 555-4567" } ]
last
Smith
Datastore PHONE PK_PHONE
FK_CUST
type
number
1
1
home
212-555-1234
2
1
work
646-555-4567
Copyright © 2014 Oracle and/or its s. All rights reserved. |
Invoking OWB 11.2 Processes from ODI 12c • New ‘OWB Runtime Repository’ technology available in Topology • OWB processes can be invoked using the OdiStartOwbJob tool in Packages • OWB audit information is available in Operator, ODI Console and Enterprise Manager
Copyright © 2014 Oracle and/or its s. All rights reserved. | Oracle OpenWorld 2014
15
Oracle Warehouse Builder Migration • for incremental migration
• Objects already created by a previous migration will now be reused when MIGRATION_STRATEGY option is set to NODUP
• for migrating to ODI 12.1.2 and 12.1.3 from OWB 11.2.0.3 and 11.2.0.4 • Bug fixes from the previous release
Copyright © 2014 Oracle and/or its s. All rights reserved. |
Management Pack for Oracle Data Integrator (1)
• New in the 12.1.0.6 FMW Plugins release • IBM DB2 (repository and source/target) • Microsoft SQL Server (repository and source/target) • Redesigned Load Plan Execution/Sessions page
• More information at http://my.oracle.com/site/pd/fmw/products/DI/SalesPlays/mgmtodi/index.html
• Additional License needed
Copyright © 2014 Oracle and/or its s. All rights reserved. |
Management Pack for Oracle Data Integrator (2)
• Discovery of ODI components • Agents: Standalone and JEE • Repositories • Source and Target databases
• Monitoring • Availability Monitoring • ODI homepage to quickly assess infrastructure status • Performance Monitoring • ODI components performance
Copyright © 2014 Oracle and/or its s. All rights reserved. | Oracle OpenWorld 2014
18
ODI Big Data – HBase and Hive
• HBase now ed as a Big Data source or target • New Knowledge Modules for Hbase • RKM HBase • LKM HBase to Hive • IKM Hive to HBase Incremental Update
• for Hive Append • Existing KMs enhanced to append
Copyright © 2014 Oracle and/or its s. All rights reserved. |
ODI Big Data – SQOOP Load
• Fast Load between databases and Hadoop • Database can be source or target • HDFS, Hive, or HBase ed • Parallelized load using a data
Oracle Data Integrator
Parallel JDBC Queries
SQOOP
HDFS
SQOOP
HDFS
SQOOP
HDFS
partitioning scheme Source Database
Copyright © 2014 Oracle and/or its s. All rights reserved. |
Terminology
• Mappings was renamed to Interfaces
Copyright © 2014 Oracle and/or its s. All rights reserved. | Oracle OpenWorld 2014
21
Useful Links • ODI 12c New Features: http://www.oracle.com/us/products/middleware/data-integration/odi-12c-new-features-wp-2226353.pdf
• PM Wiki: http://my.oracle.com/site/pd/fmw/products/di/odi/index.html
• ODI 12.1.3 Demo VM: http://retriever.us.oracle.com/apex/f?p=121:22:9208677187768:22:::P22_CONTAINER_ID:68263
• ODI 12.1.3 OTN VM: http://www.oracle.com/technetwork/middleware/data-integrator/odi-demo-2032565.html
• Blogs • Data Integration: https://blogs.oracle.com/dataintegration/ • A-Team: http://www.ateam-oracle.com/?cat=64
Copyright © 2014 Oracle and/or its s. All rights reserved. |
Resources Oracle Data Integrator
Oracle Data Integration
Oracle GoldenGate
Oracle Data Integration
Oracle Enterprise Data Quality
Oracle Enterprise Metadata Management
ORCL DataIntegration
blogs.oracle.com/dataint egration
Oracle Data Services Integrator
OracleGoldenGate
Data Integration
http://www.oracle.com/us/products/middleware/data-integration/overview/index.html
Copyright © 2014 Oracle and/or its s. All rights reserved. | Oracle OpenWorld 2014
23
Questions and Answers
Copyright © 2014 Oracle and/or its s. All rights reserved. | Oracle OpenWorld 2014
24
Copyright © 2014 Oracle and/or its s. All rights reserved. |
25
Joachim Jaensch Principal Sales Consultant
Copyright © 2014 Oracle and/or its s. All rights reserved. |
Safe Harbor Statement The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.
Copyright © 2014 Oracle and/or its s. All rights reserved. |
3
What‘s New In Oracle Data Integrator 12c? • • • • • • • • • • • • •
Declarative Flow-Based Interface Reusable Mappings Multi-Threaded Target Load Step-by-Step Debugger Runtime Performance Enhancement Oracle GoldenGate Integration Improvements Standalone Agent Management with WebLogic Management Framework Integration with Oracle Platform Security Services (OPSS) Enterprise Roles JSON and XML Improvements Oracle Warehouse Builder (OWB) Integration OWB to ODI Migration Tool OEM – Management Pack for Oracle Data Integrator New Mapping Components: PIVOT, UNPIVOT
Copyright © 2014 Oracle and/or its s. All rights reserved. | Oracle OpenWorld 2014
4
Reusable Mappings • Capture common logic (sources, targets, transformations) • Reuse logic in mappings
Copyright © 2014 Oracle and/or its s. All rights reserved. | Oracle OpenWorld 2014
5
Multi-Threaded Target Load Data Server settings:
• Fast Load through parallel JDBC connections • Configurable per Data Server
Parallel Load Threads
JDBC Source
ODI Agent
Copyright © 2014 Oracle and/or its s. All rights reserved. |
Target Database
In-Session Parallelism ODI 11g
• Goal
SrcSet1 SrcSet2
• Allow the execution of tasks and steps in
SrcSet3
parallel rather than sequentially
• How • Introduction of a new Runtime concept: •
Execution Units In 12.1.2 loading of C$ tables can be executed in parallel
Integration
Total Execution Time
ODI 12.1.2 SrcSet1 SrcSet2
Integration
SrcSet3
Total Execution Time
Copyright © 2014 Oracle and/or its s. All rights reserved. | Oracle OpenWorld 2014
7
Low Overhead Session Execution • Goal
• Reduce status and session management overhead
• How
• Cache and reuse a Session Blueprint instead of accessing the ODI repositories • Avoid writing logs in the repository when it is not necessary
• Benefits
• Better performance when executing scenarios multiple times, when restarting a session,
•
when logging sessions activity Less fragmentation of repository tables
Copyright © 2014 Oracle and/or its s. All rights reserved. | Oracle OpenWorld 2014
8
Concurrent Execution Control • You can now limit concurrent executions in a scenario or load plan and force a concurrent execution to either wait or raise an execution error
Copyright © 2014 Oracle and/or its s. All rights reserved. |
Step by Step Debugger • Give control to the on the Execution Flow of a Session • Pause, Resume, Run to next Step, etc.
• Define breakpoints on steps in packages • Toggle breakpoints in Sessions • Query data through agent (gives access to uncommitted data)
• Start a session with the option to wait for inputs on Error
Copyright © 2014 Oracle and/or its s. All rights reserved. |
One-Step Model and Topology Creation
• One dialog to create all metadata objects: • Data Server • Physical and Logical Schema • Context • Model • Simplifies and accelerates ODI development
Copyright © 2014 Oracle and/or its s. All rights reserved. |
Integration Between GoldenGate and ODI 12c
• Enable GoldenGate Journalizing on Interfaces without restructuring.
• Manage GoldenGate Capture/Delivery instances in ODI Topology
• Set common GoldenGate parameters graphically Bulk Load Scenario
Real Time Scenario
• Deploy GoldenGate Processes via ODI • Real-Time and Bulk from the same Interface
Extract
Replicat
Copyright © 2014 Oracle and/or its s. All rights reserved. | Oracle OpenWorld 2014
12
Security Enhancements
• Product-wide standardization on AES encryption • FIPS compliant (US) • AES key 128bit by default, algorithm and key length can be configured: 128, 192 & 256.
• ODI import and export uses secure encryption for sensitive data
Copyright © 2014 Oracle and/or its s. All rights reserved. |
Improved JSON and XML {
• Complex File Driver reads and writes JSON • Conversion to tabular Datastore format • XML for advanced constructs: Datastore CUST • any, anyType, anyAttribute PK_CUST first 1 John • Custom XML column mappings
}
JSON
"first": "John", "last": "Smith", "phone": [ { "type": "home", "number": "212 555-1234" }, { "type": "work", "number": "646 555-4567" } ]
last
Smith
Datastore PHONE PK_PHONE
FK_CUST
type
number
1
1
home
212-555-1234
2
1
work
646-555-4567
Copyright © 2014 Oracle and/or its s. All rights reserved. |
Invoking OWB 11.2 Processes from ODI 12c • New ‘OWB Runtime Repository’ technology available in Topology • OWB processes can be invoked using the OdiStartOwbJob tool in Packages • OWB audit information is available in Operator, ODI Console and Enterprise Manager
Copyright © 2014 Oracle and/or its s. All rights reserved. | Oracle OpenWorld 2014
15
Oracle Warehouse Builder Migration • for incremental migration
• Objects already created by a previous migration will now be reused when MIGRATION_STRATEGY option is set to NODUP
• for migrating to ODI 12.1.2 and 12.1.3 from OWB 11.2.0.3 and 11.2.0.4 • Bug fixes from the previous release
Copyright © 2014 Oracle and/or its s. All rights reserved. |
Management Pack for Oracle Data Integrator (1)
• New in the 12.1.0.6 FMW Plugins release • IBM DB2 (repository and source/target) • Microsoft SQL Server (repository and source/target) • Redesigned Load Plan Execution/Sessions page
• More information at http://my.oracle.com/site/pd/fmw/products/DI/SalesPlays/mgmtodi/index.html
• Additional License needed
Copyright © 2014 Oracle and/or its s. All rights reserved. |
Management Pack for Oracle Data Integrator (2)
• Discovery of ODI components • Agents: Standalone and JEE • Repositories • Source and Target databases
• Monitoring • Availability Monitoring • ODI homepage to quickly assess infrastructure status • Performance Monitoring • ODI components performance
Copyright © 2014 Oracle and/or its s. All rights reserved. | Oracle OpenWorld 2014
18
ODI Big Data – HBase and Hive
• HBase now ed as a Big Data source or target • New Knowledge Modules for Hbase • RKM HBase • LKM HBase to Hive • IKM Hive to HBase Incremental Update
• for Hive Append • Existing KMs enhanced to append
Copyright © 2014 Oracle and/or its s. All rights reserved. |
ODI Big Data – SQOOP Load
• Fast Load between databases and Hadoop • Database can be source or target • HDFS, Hive, or HBase ed • Parallelized load using a data
Oracle Data Integrator
Parallel JDBC Queries
SQOOP
HDFS
SQOOP
HDFS
SQOOP
HDFS
partitioning scheme Source Database
Copyright © 2014 Oracle and/or its s. All rights reserved. |
Terminology
• Mappings was renamed to Interfaces
Copyright © 2014 Oracle and/or its s. All rights reserved. | Oracle OpenWorld 2014
21
Useful Links • ODI 12c New Features: http://www.oracle.com/us/products/middleware/data-integration/odi-12c-new-features-wp-2226353.pdf
• PM Wiki: http://my.oracle.com/site/pd/fmw/products/di/odi/index.html
• ODI 12.1.3 Demo VM: http://retriever.us.oracle.com/apex/f?p=121:22:9208677187768:22:::P22_CONTAINER_ID:68263
• ODI 12.1.3 OTN VM: http://www.oracle.com/technetwork/middleware/data-integrator/odi-demo-2032565.html
• Blogs • Data Integration: https://blogs.oracle.com/dataintegration/ • A-Team: http://www.ateam-oracle.com/?cat=64
Copyright © 2014 Oracle and/or its s. All rights reserved. |
Resources Oracle Data Integrator
Oracle Data Integration
Oracle GoldenGate
Oracle Data Integration
Oracle Enterprise Data Quality
Oracle Enterprise Metadata Management
ORCL DataIntegration
blogs.oracle.com/dataint egration
Oracle Data Services Integrator
OracleGoldenGate
Data Integration
http://www.oracle.com/us/products/middleware/data-integration/overview/index.html
Copyright © 2014 Oracle and/or its s. All rights reserved. | Oracle OpenWorld 2014
23
Questions and Answers
Copyright © 2014 Oracle and/or its s. All rights reserved. | Oracle OpenWorld 2014
24
Copyright © 2014 Oracle and/or its s. All rights reserved. |
25
Related Documents 3h463d
Oracle Odi 12c New Features 5h381h
December 2019 51
Odi 12c New Features Wp 2226353 2x3l3i
November 2019 31
Odi 12c 5i4ys
December 2019 75
Rac New Features In Oracle 9i-10g-11g-12c 1lz3n
November 2019 61
D77758gc10_51_e Oracle Database 12c New Features For s 5t216j
October 2019 30
December 2019 178