Lavora con noi

IT

Senior Big Data Engineer

  • Milano
  • Altro
  • Full time
  • Tempo indeterminato
  • Laurea

Founded in 2007 in Milan, Subito is the first Digital Company in Italy to manage private deals. Part of Schibsted Media Group – a Norwegian multinational company, with more than 6,900 employees in 29 Countries – Subito is known as the easiest, fastest and safest Web Platform in this market and also for its smart, youthful and passionate work environment.

Technology is at the heart of Subito, with more than 40% of our organization working in Information Technology and a fast growing team of analytics experts to turn data into insights and to give customers the best experience across contents and services.

In this scenario, Subito is looking for a savvy Senior Data Engineer, excited by the prospect of optimizing and re-designing our Digital Platform and to support a new generation of data-driven services and initiatives. The hired will be responsible for expanding and optimizing our data pipeline architecture, supporting Data Architects, Data Scientists, Data Analysts and Software Engineers with optimal data delivery architectures and services.

In Subito there will be the possibility to work on an up to date environments and technologies, managing over 6 million ads, more than 8 million unique users monthly and over 30 million daily page views on our App and Website. Subito also provides a continuous training program, related to technology evolution, individual carrier path and ad-hoc requisitions.

As a Senior Data Engineer, you will work these main goals and responsibilities:

  • Active participation on our platform technologies and infrastructure evolution, for greater scalability, data providing, etc. also with self-exploration and experimentation of new data environment and framework.
  • Responsibility on data quality, integrity, scalability and availability.
  • Relationship with Schibsted Media Group in other countries, to discuss and manage technology evolution line guides.

The ideal candidate has a strong experience and passion in Data Engineering field. Working experience in Web Companies/ICT Consultancy and a knowledge of Machine Learning/AI are appreciated.

KEY ACTIVITIES

  • Create, maintain and evolve an optimal data pipeline architecture.
  • Meet data team requirements, assembling large and complex datasets with a wide variety of data source.
  • Work on data extraction, enrichment, transformation ad integration through ETL/API.
  • Support experiments, development and debugging of algorithms.
  • Build robust workflows for training, evaluation and deploying algorithms at scale.
  • Monitoring performance, work with data-related technical issues and advising any necessary infrastructure changes.

KEY COMPETENCES

  • Strong experience in highly scalable distributed systems and high volume data.
  • Deep knowledge in Kafka.
  • Deep knowledge with the design of efficient and robust ETL workflows (e.g. Kettle).
  • Deep knowledge of AWS Redshift.
  • Deep knowledge in different programming languages like Java, Scala and Python.
  • Experience with Airflow or other data pipeline and workflow management tools like Azkaban, Luigi, etc.
  • Experience with Postgres or other relational SQL and NoSQL databases (e.g. ElasticSearch, Cassandra, etc.).
  • Experience in supporting high-performance algorithms data pipeline.
  • Experience with object-oriented design, coding and testing patterns.
  • Knowledge of Big Data tools and framework like Hadoop, Spark, etc.
  • Knowledge of stream-processing systems, like Storm, Spark-Streaming, etc.
  • High/Good English proficiency level is required.
  • Are also appreciated the knowledge of Amazon AWS Stack, Agile Methodology, and experience in supporting and working with cross-functional teams in a dynamic environment.

Subito People are required to have a strong cultural fit with the organization, based on a customer-first mindset, teamworking-based activities, agility and passion for challenge. Our Senior Big Data Engineers also expected to put in place a correct technical leadership and education capabilities. Subito is located in Milan – Via B. Crespi 19, 20159 – in a rewarded office, near to other Schibsted Media Group companies like InfoJobs and PagoMeno.

The target compensation package includes a base salary (based upon the candidate’s skills and experience) in addition to other Subito benefits like advanced Personal Computer, Smartworking, Concierge, etc.

Candidates are asked to answer only if they have the required requirements, specifying within the CV the knowledge degree in relation to the technical skills required.

 

Compila la tua candidatura

Allega il tuo curriculum in formato PDF o WORD (Max: 2.5Mb.)