Hi guys
See below three Job Descriptions. The project aims to extend the data capability with a major international luxury brand. They have a portfolio of projects coming including the creation of a local data lake; the current team is spread across HK, Europe (mostly France & Italy) and Shanghai (expect to spend some time there, esp. for role #1)
Profile #1 and #2 are quite similar, only #1 is more senior.
English is a must; Putonghua a good to have.
Feel free to contact me here for more info
1/ Technical Leader
Main skills
- Ability to interact with various people : technical architect, developers, infrastructure, business stakeholders
- Expertise in distributed data technologies (Hadoop, at least one NoSQL technologie (MongDB, Cassandra)
- Expertise in data development (Spark, Python, Scala) using Agile methodology
- Knowledge to Apache Nifi, Kafka, cloud technologies
- Software development best practices (unit tests, integration test and CI/CD)
- Used to work in an Agile way
- Cloud Infrastructure + Data Architecture (Alibaba)
Roles & reponsabilities
- Responsible of Data projects
- Analyse project in each of its step and fix identified errors
- Implement best practices and coding standard
- Participate defining best practices with others data teams in AMER & EMEA
- Leck on the whole system, conduct the testing and integration testing for the entire system.
- Ensure proper coordination with others teams : from infrastructure to business stakeholders
2/ Data Engineer
Main skills
- Expertise in distributed data technologies (Hadoop, at least one NoSQL technologie (MongDB, Cassandra)
- Expertise in data development (Spark, Python, Scala)
- Knowledge to Apache Nifi, Kafka, cloud technologies
- Software development best practices (unit tests, integration test and CI/CD)
- Used to work in an Agile way
Roles & reponsabilities
- Gather user needs and :
- Develop data models with others data community members
- Build ingestion flows
- Build data transformation
- Develop datamart for users
- Responsible for design methodology and project documentation.
- Data cleansing
3/ Tester
Main skills
- Expertise in development in distributed environment, especially on data ingestion/processing tehcnologies (Nifi, Kafka, Spark)
- Software development best practices (unit tests, integration test and CI/CD)
- Ability to perform SQL queries and build python scripts to generate tests datasets
- Used to work in an Agile way
Roles & reponsabilities
- Develop and define the glue architecture of gherkin tests scenario
- Support the gherkin writing of acceptance tests Skills:
- Java
- gherkin (Given When Then)
- Jenkins
- (cucumber)
- (docker)