The Horizon Datastore team is responsible for driving growth, managing capacity and driving down the operational challenges of Oracle Cloud Infrastructure business with data driven insights from telemetry and business data sources. The Horizon Datastore is built on Oracle Cloud Technologies such as Autonomous Data Warehouse and Oracle Analytics Cloud.
Some of the main Objectives of the Horizon Datastore are: Efficiently load and transform data into a DWH Provide advanced orchestration to use Data Lake based approach Integration with Oracle Autonomous DataWarehouse, Object Storage and Oracle Data Catalog Data movement in both batch and real-time change data capture Leverage Big Data technologies (Spark) to ingest, clean & transform data Apply Machine Learning on DWH to proactively figure out issues
You will be responsible for applying your extensive knowledge as a data engineer and architect the Horizon Datastore. You will solve difficult problems in distributed highly available services and virtualized infrastructure which you would need to solve with DWH, Spark and ML technologies.
Our Ideal Candidate
We are looking for a strong Data Engineer who thrives on research and development projects. Be technically strong and hands on leader, who works efficiently with other product groups and data architects and engineering leaders to make sure we are building the right product and services using the right design principles.
As an integral part of the OCI development team, the Data Engineer at Oracle Cloud Infrastructure will participate in Building global scale data ingestion, analytics and prediction frameworks for Oracle Cloud Infrastructure (OCI) and its customers. Build flexible and scalable solutions for sourcing and ingesting Petabytes worth of structured and non-structured data. Design, build and maintain data warehouse, organize data into subject areas, understand data consumption and data visualization components using core Oracle technologies. Work closely with business teams to develop these platforms that will drive the next generation of data science and predictive insights/intelligence. Working directly with architects to ensure newer capabilities are built applying right design principles Working with remote and geographically distributed teams to enable building the right products, using the right building blocks and making them consumable by other products easily Be very technically hands-on and own/drive key end to end product/services Ensure customer success including delivering fixes/patches as needed
Basic Qualifications BS/MS/PhD in Computer Science or related fields. 10+ years of data management and engineering 10+ years as a Data Engineer working with Petabyte scale Data Warehouses and Data Lakes 10+ Years hands on experience with PL/SQL, ETL design and Orchestration 10+ years of data profiling, data validation and performance improvement experience for Analytical and OLTP systems 10+ years of Object Oriented software development experience, Java/Python Strong problem solving, troubleshooting and analytical skills. Ability to quickly learn new technologies in a dynamic environment. Good organization, communication and interpersonal skills. Prior experience with Agile process
Preferred Qualifications Experience with Oracle suite of products including Oracle Database, Oracle Autonomous Data Warehouse, Oracle Application Cloud, Oracle Data Integration, OBIEE Hands-on hardware management and operating systems experience (Unix, Linux) Hands-on experience working with cloud technologies (OCI, AWS, Azure, GCP)