Big data infrastructure internship | Adaltas

Career description

Large Knowledge and distributed computing are at the core of Adaltas. We accompagny our associates in the deployment, upkeep, and optimization of some of the major clusters in France. Because a short while ago we also deliver aid for day-day operations.

As a excellent defender and energetic contributor of open up source, we are at the forefront of the information platform initiative TDP (TOSIT Information System).

For the duration of this internship, you will contribute to the growth of TDP, its industrialization, and the integration of new open up supply factors and new functionalities. You will be accompanied by the Alliage specialist crew in cost of TDP editor aid.

You will also operate with the Kubernetes ecosystem and the automation of datalab deployments Onyxia, which we want to make out there to our clients as very well as to learners as part of our training modules (devops, massive info, and so on.).

Your skills will enable to increase the expert services of Alliage’s open up source assistance presenting. Supported open resource components incorporate TDP, Onyxia, ScyllaDB, … For those people who would like to do some world-wide-web operate in addition to huge details, we already have a incredibly functional intranet (ticket administration, time administration, highly developed lookup, mentions and similar posts, …) but other pleasant characteristics are expected.

You will practice GitOps release chains and produce articles or blog posts.

You will get the job done in a crew with senior advisors as mentor.

Firm presentation

Adaltas is a consulting company led by a team of open supply experts focusing on facts administration. We deploy and function the storage and computing infrastructures in collaboration with our customers.

Companion with Cloudera and Databricks, we are also open up resource contributors. We invite you to search our web page and our a lot of specialized publications to study far more about the corporation.

Skills expected and to be obtained

Automating the deployment of the Onyxia datalab calls for awareness of Kubernetes and Cloud native. You must be comfortable with the Kubernetes ecosystem, the Hadoop ecosystem, and the distributed computing product. You will learn how the primary components (HDFS, YARN, object storage, Kerberos, OAuth, and so on.) function together to fulfill the employs of massive information.

A excellent information of working with Linux and the command line is demanded.

During the internship, you will learn:

• The Kubernetes/Hadoop ecosystem in buy to add to the TDP undertaking
• Securing clusters with Kerberos and SSL/TLS certificates
• High availability (HA) of solutions
• The distribution of means and workloads
• Supervision of expert services and hosted purposes
• Fault tolerant Hadoop cluster with recoverability of misplaced data on infrastructure failure
• Infrastructure as Code (IaC) by using DevOps tools these kinds of as Ansible and [Vagrant](/en/tag/hashicorp- vagrant/)
• Be comfortable with the architecture and operation of a facts lakehouse
• Code collaboration with Git, Gitlab and Github

Responsibilities

• Come to be common with the architecture and configuration methods of the TDP distribution
• Deploy and examination protected and really readily available TDP clusters
• Add to the TDP information foundation with troubleshooting guides, FAQs and articles or blog posts
• Actively lead suggestions and code to make iterative advancements to the TDP ecosystem
• Investigate and examine the differences among the most important Hadoop distributions
• Update Adaltas Cloud working with Nikita
• Lead to the advancement of a device to collect client logs and metrics on TDP and ScyllaDB
• Actively add ideas to establish our support remedy

Added information and facts

• Spot: Boulogne Billancourt, France
• Languages: French or English
• Setting up day: March 2023
• Duration: 6 months

Much of the digital planet operates on Open Resource computer software and the Significant Facts marketplace is booming. This internship is an possibility to attain beneficial encounter in both domains. TDP is now the only genuinely Open Supply Hadoop distribution. This is a great momentum. As section of the TDP workforce, you will have the likelihood to master one particular of the main big knowledge processing styles and take part in the progress and the long term roadmap of TDP. We imagine that this is an thrilling possibility and that on completion of the internship, you will be ready for a prosperous profession in Massive Info.

Tools out there

A laptop with the next characteristics:

• 32GB RAM
• 1TB SSD
• 8c/16t CPU

A cluster created up of:

• 3x 28c/56t Intel Xeon Scalable Gold 6132
• 3x 192TB RAM DDR4 ECC 2666MHz
• 3x 14 SSD 480GB SATA Intel S4500 6Gbps

A Kubernetes cluster and a Hadoop cluster.

Remuneration

• Income 1200 € / thirty day period
• Restaurant tickets
• Transportation move
• Participation in a single worldwide conference

In the previous, the conferences which we attended incorporate the KubeCon structured by the CNCF foundation, the Open Supply Summit from the Linux Basis and the Fosdem.

For any request for further information and to post your software, remember to get in touch with David Worms: