As part of Data Services organization, we are passionate about enabling data users and data architects to build large scale data applications at ease, from processing healthcare data for medical research, network anomaly detection to AI machine learning and model training. We build and integrate multiple data frameworks from open-source ecosystem to enable these data applications to run seamlessly on Oracle Cloud Infrastructure (OCI).

OCI Data Flow is a fully managed Apache Spark service that performs processing tasks on extremely large datasets, without infrastructure to deploy or manage. Data engineers can use Spark Structured Streaming to process their streaming data in a continuous fashion with minimum data latency. Jupyter Notebook integration enabled data scientists to perform ad-hoc analysis on petabytes of data in Data Lake, backed by OCI Object Storage or other storage platforms.

We are looking for a senior software engineer who are excited to scale large distributed system, build next-generation SQL query engine, optimize performance with data storage system, and develop seamless enterprise grade security.

What we look for:

BS (or higher) in Computer Science or related engineering fields. 3+ years of career experiences in Java or Scala. Knowledge in Python is a plus. Solid foundation in data structures and algorithms. Experiences with distributed systems, databases, and big data systems (Apache Spark, Delta Lake, Hadoop). Knowledge in SQL is a plus. Experiences in developing open-source data framework is a plus. Background in batch and streaming data processing and analytics is a plus.

Career Level - IC3