Role Proficiency:

This role requires proficiency in data pipeline development including coding testing and implementing data pipelines for ingesting wrangling transforming and joining data from various sources. Must be adept at using ETL tools such as Informatica Glue Databricks and DataProc along with coding skills in Python PySpark and SQL. Works independently according to work allocation.

Outcomes:

Operate with minimal guidance to develop error-free code test applications and document the development process. Understand application features and component designs to develop them in accordance with user stories and requirements. Code debug test document and communicate the stages of product component or feature development. Develop optimized code using appropriate approaches and algorithms while adhering to standards and security guidelines independently. Complete foundational level certifications in Azure AWS or GCP. Demonstrate proficiency in writing advanced SQL queries.

Measures of Outcomes:

Adherence to engineering processes and standards Adherence to schedule / timelines Adhere to SLAs where applicable # of defects post delivery # of non-compliance issues Reduction of reoccurrence of known defects Quickly turnaround production bugs Completion of applicable technical/domain certifications Completion of all mandatory training requirements

Outputs Expected:

Code Development:

Develop data processing code independently
ensuring it meets performance and scalability requirements.

Documentation:

Create comprehensive documentation for personal work and ensure it aligns with project standards.

Configuration:

Follow the configuration process diligently.

Testing:

Create and conduct unit tests for data pipelines and transformations to ensure data quality and correctness.

Domain Relevance:

Develop features and components with a solid understanding of the business problems being addressed for the client.

Defect Management:

Raise
fix
and retest defects in accordance with project standards.

Estimation:

Estimate time
effort
and resource dependencies for personal work.

Knowledge Management:

Consume and contribute to project-related documents
SharePoint
libraries
and client universities.

Release Management:

Adhere to the release management process for seamless deployment.

Design Understanding:

Understand the design and low-level design (LLD) and link it to requirements and user stories.

Certifications:

Obtain relevant technology certifications to enhance skills and knowledge.

Skill Examples:

Proficiency in SQL Python or other programming languages utilized for data manipulation. Experience with ETL tools such as Apache Airflow Talend Informatica AWS Glue Dataproc and Azure ADF. Hands-on experience with cloud platforms like AWS Azure or Google Cloud particularly with data-related services (e.g. AWS Glue BigQuery). Conduct tests on data pipelines and evaluate results against data quality and performance specifications.

Knowledge Examples:

Knowledge Examples

Knowledge of various ETL services used by cloud providers including Apache PySpark AWS Glue GCP DataProc/DataFlow and Azure ADF/ADLF. Proficiency in SQL for analytics including windowing functions. Understanding of data schemas and models

Additional Comments:

Role - Python developer Experience - (2-5yrs) The team works closely with the business and is focused on delivering cutting-edge technology to the firm's internal and external clients. A key part of this is the development of a new consolidated KDB platform to manage all the data requirements around these products while developing new tools and systems to streamline business processes and enable the business to expand into new areas. The role involves all aspects of the software development life cycle: analysis, design and implementation. We need a flexible and practical technologist who demonstrates excellent problem solving skills, enjoys all aspects of software development and will contribute to the success of the team. Role Profile: • You will work on and be responsible for a large tick based KDB plant and associate access points/API for the various consumers, from quants, backtesting systems, to algo trading systems. • You will be part of a team of highly skilled developers • You will be able to provide input into the strategic direction for the team and provide key input in to design decisions • You will improve the system constantly to achieve stability and scale. • You will design and consult on q queries to achieve analytics objectives of the various clients. • You will partner with the desk strategists to deliver a commercial platform, where reactivity will be key. Desired Skills: • Experience in designing/building/maintaining data systems • Knowledge of KDB an advantage • Good team working • Exposure to Python and SQL • Knowledge of Java an advantage • Understanding of Equity Derivatives Products would be an advantage • Outstanding communication and interpersonal skills • Experience of working in an agile environment