Zur Startseite
Navigation
  • Jobs
    Kein Job gleicht dem anderen. Schau dich in unserer Jobbörse um und finde deinen Traumjob.
    • JobsucheFinde deinen passenden Job bei OTTO
    • JobtickerErhalte passende Jobvorschläge
    • ProfilbereichLeg dir ein Profil an und profitiere von allen Vorteilen
  • Wir sind OTTO
    Erfahre mehr über OTTO als Arbeitgeber - was uns ausmacht und wie wir ticken.
    • VisionWonach wir alle streben
    • VerantwortungWas uns alle vereint
    • BenefitsWovon wir alle profitieren
    • OnboardingWomit wir alle starten
    • KulturWas uns alle ausmacht
    • KarrierewegeWie wir uns gemeinsam weiterentwickeln
    • New WorkWie wir arbeiten
    • A people company.Was wir dir bieten
  • Deine Möglichkeiten
    Die Möglichkeiten, bei OTTO die Zukunft zu gestalten, sind grenzenlos. Entdecke die verschiedenen Einstiegsmöglichkeiten, die wir dir bieten.
    • EinstiegsbereicheUnsere Berufsfelder
    • Schüler*innenNach der Schule
    • StudierendeIm Studium
    • BerufseinstiegNach dem ersten Abschluss
    • BerufserfahreneMit mehreren Jahren Erfahrung
  • Technologie
    Wir lieben Technologien und setzen Methoden, Frameworks und Infrastruktur ein, die zu uns passen. OTTO Tech gibt dir einen Eindruck zu unseren Arbeitsweisen, Technologien und Menschen von OTTO.
    • Tech-HubVerschaffe dir einen Überblick über alle Tech-Themen
    • Tech-BlogLies dich in unsere Themen
    • Open Source ProjekteEntdecke offene Technologien
    • ArbeitsweisenFinde heraus, wie wir arbeiten
    • TeamLerne unsere Teams kennen
  • Rund ums Bewerben
    In unserem Bewerbungsprozess steht der Mensch im Mittelpunkt. Daher möchten wir dich mit allen Informationen rund um deine Bewerbung bei uns versorgen.
    • BewerbungstippsErfahre hier alles rund um deine Bewerbung bei OTTO
    • KontaktErreiche immer die Richtigen
    • Hilfe und SupportFinde hier jede Antwort auf all deine Fragen
    • CampusVerschaffe dir einen Überblick
    • StandorteFinde OTTO in deiner Stadt
    • ServicesNutze die Features auf otto.jobs
  • Jobnews & Events
    Bei OTTO ist immer etwas los. Unsere Jobnews & Events verschaffen dir einen Überblick darüber, was bei OTTO passiert und welche Events du besuchen kannst.
    • JobnewsInformiere dich über Neuigkeiten
    • Tech-BlogLies dich in unsere Technologie
    • EventsNimm an spannenden Events teil
    • Azubi-BlogDie Ausbildung hautnah erleben
 
1
 
Finde, was du suchst.
Informationen
Jobs
 
Profil
In deinem persönlichen Profilbereich kannst du den Status deiner Bewerbung einsehen, unvollständige Bewerbungen zwischenspeichern und aktuelle News und Events einsehen
EinloggenRegistrieren
27. April 2022

The Open Source Private Cloud in the Otto Group

development
operations
cloud
 
 
 
 
 
 
 
 
 
 
 
 
 

What is the article about?

The term ‘cloud’ has been much more than just a buzzword for a long time now. The cloud, or rather the clouds, have become an essential part of our daily business. But what if – even though the wheat has long since been separated from the chaff in terms of IT expertise – I still don't know much about the cloud? Simply fly blind into the big, wide world of public clouds? Knock something together in a web frontend with a few clicks and see how it feels? ‘Cloudformation’? ‘DevOps’? Hang on… What?! To be able to test properly, I also need to dump my data into some bucket and get busy with it…? Well, everyone knows that practice makes perfect – so let’s go for it!

Well, we find that approach a little reckless. But what if there were a safe sandpit – so safe that I could play with the cloud almost totally blind, to build my experience and know-how? Sounds good, eh? Well, that's just what we thought too, and that's why we built precisely this fully containerised sandpit: the ‘Open Cloud Platform’ or ‘OCP’ for short.

But who are ‘we’ exactly? We’re a virtual team from the Cloud & Infrastructure Services Division at Otto Group IT. Our specialist background comprises the virtualization, storage, networking, and DevOps areas.

We’ve operated the VMware private cloud environment ‘SPICE’ successfully for many years. Our customers include internal teams as well as Group companies that acquire ‘Managed Services’ from us, usually in the form of Virtual Machines.

With the trend shift towards the public cloud, calls for an agile, scalable private cloud environment within the Group were also getting louder. We quickly realised there was an urgent need for action here in order to stay on the cutting edge and offer our customers the best-possible service. And so the Open Cloud Platform was born.

What‘s the Open Cloud Platform?

OCP is a private cloud within the Otto Group campus networks that’s closely based on hyperscaler functionalities. The users themselves hold the reins here. They can act with complete freedom within their private cloud area, try ideas out, build them, tear bits off, break them down – and start all over again.

Of course, OCP is also prepared for productive operations and already houses the first productive environments such as Th!ngs. Th!ngs is an application bundling many microservices – to cross-charge customers for Otto Group IT services via SAP, for instance. Public cloud accounts that Otto Group IT provides to its customers have also been cross-charged in Th!ngs since 2022.

Highly complex platforms with their own (virtual) networks, routers, DNS services, security groups, load-balancing, containers or compute instances – all these cloud resources can be consumed in OCP via WebUI or REST API. Just a moment… REST API, what was that? Exactly. Tools such as Terraform use REST API to set up the required infrastructure (IaC) fully automatically. We created a private cloud here in which the possibilities are practically unlimited. It also has the small but subtle difference that it’s impossible to accidentally upload something to the Internet that really doesn’t belong there. Everything takes place on pretty hefty cloud nodes at our Data Centres on the OTTO Campus and at an externally operated co-location in the Greater Hamburg area.

Arbeitssituation
Arbeitssituation

"Our entire tech stack is a colourful mix of 100% open source software, something we’re more than proud of."

The tech stack behind OCP

Automation starts as soon as a tech has bolted the physical server into the rack and switched it on. This still relatively cold chunk of hardware blips a DHCP request into the network and receives the necessary boot parameters via PXE – we use MaaS for this. The server is kitted out fully automatically with an OS; the basic network configuration as well as hard disk partitioning etc. are also carried out here. After certain tags are assigned within MaaS that determine the role of the node (e.g. compute node), the machine is in ‘ready to deploy’ state, meaning the server is ready to become a cloud node. Yay!

Our cloud is based on the ‘OpenStack’ cloud framework which has been tried and tested over many years. Anyone who knows OpenStack knows that installing it is not (normally) a case of ‘step 1, step 2, step 3 – done’. In fact this was already the case with us, but we’ve gone one step further and have even done away with ‘step 1, step 2, step 3 – done’ completely.

Screenshot of the "Registration App"
Screenshot of the "Registration App"

Automate all the Th!ngs

Deep in our automation engine room is a Gitlab pipeline in which MaaS uses API to scans for nodes with precisely this status. As soon as it identifies such a node, another well-known friend is sent into the race – Ansible. Some people might now think, "ok, they take Ansible and install the OpenStack packages." Nope! We run OpenStack 100% containerized in Docker, including Hypervisor and SDN (Software Defined Network). We find Ansible to be just a slightly better Docker compose: it rolls out the required containers, selected based on the tags from MaaS, to the node and takes over the configuration of the various OpenStack components such as Nova, Neutron and Keystone etc.

Once again, we didn't reinvent the wheel here. The OpenStack community has realized that installing and operating OpenStack based on packages means a whole lot of pain. Our deployment tool of choice became Kolla/Kolla-Ansible. Since we have very special requirements, we still had to write our own code to make Kolla/Kolla-Ansible suit our needs. In line with the open source ethic, we have of course returned this code to the community.

So what else needs to be done after all OpenStack services are up and running on the new node? In a nutshell – nothing. Once the pipelines have been successfully completed, the node is productive and can usually already run newly created cloud resources.

The other way around, i.e. when a node needs to be retired, of course it works the same way. In OCP, we operate fully automated up/downscaling with hardware.

OpenStack (OCP) Dashbord
OpenStack (OCP) Dashbord

Automation right through to the end.

Does automation stop here? Not by a long shot! Our monitoring and logging is also thoroughly automated. This means the usual suspects such as Grafana, Prometheus, ELK, CheckMK, Alerta and many more are rolled out automatically and configured in containers. The resources that need to be monitored are also automatically integrated in the above-mentioned tools.

The Open Cloud Platform is being further developed and optimized constantly and will offer its users many more new features going forward.

We are happy to have created a product that offers a high level of data protection security and agility at the same time, and which is now used by more and more Otto Group Holding Divisions and Group companies. OCP provides a protected space for cloud newbies and is aimed at agile development teams for whom a public cloud is out of the question due to the sensitivity of their data.

Want to be part of our team?

Jobs
5 Personen gefällt das

1Kommentar

  • Thorsten Stärk
    29.04.2022 12:07 Uhr

    I can feel the enthusiasm between the lines 👍

Dein Kommentar
Antwort auf:  Direkt auf das Thema antworten
5908 - 6

Written by

Ole Kleinschmidt
Ole Kleinschmidt
Senior IT-Architect
About the author

Similar Articles

  • Life in the mob
    Marcel
    22.03.2022

    Life in the mob

    While many of us are big fans of ‘mob’ (mafia) classics like ‘The Sopranos’ and ‘The Godfather’, in fact this article shows how mob (‘collective’) programming can help shape a new team and how great results can be achieved quickly through this collaborative working approach.
    developmentworking methods
    Read more
  • Scaling product development through collaboration
    Bartholomäus, Michael
    26.10.2021

    Scaling product development through collaboration

    Together with our Product Teams, we – Bart as Agile Coach and Michael as Product Manager – took on this exciting challenge and ventured into scaling our product development process with our culture of agile collaboration at its core.
    development
    Read more

Dein Profil  -
Deine Vorteile

  • Jobticker & Jobnews
  • Gespeicherte Jobs
  • Laufende Bewerbungen
  • Bewerberstatus
Profil anlegen
Dein Profil - Deine Vorteile
Dein Profil - Deine Vorteile
Wähle bitte aus für welche Jobs du benachrichtigt werden möchtest.
E-Mail-Adresse nicht gültig

Abonniere hier unseren Jobticker, um wöchentlich per E-Mail über neue Jobs informiert zu werden.

 
 
 
 
 
 
 
 
 
 
 
 
Zur Startseite

A people company.

Driven by technology.

Otto Group KarriereOTTO-UnternehmenOTTO-Newsroomotto.de
job@otto.de

Werner-Otto-Straße 1-7
22179 Hamburg

© Otto (GmbH & Co KG), 22179 Hamburg
  • Impressum
  • Datenschutz
  • Cookie-Einstellungen

We want to improve out content with your feedback.

How interesting is this blogpost?

We have received your feedback.

Close
Jobo 
Chatbot

Cookies erlauben?

OTTO und drei Partner brauchen deine Zustimmung (Klick auf "OK") bei vereinzelnen Datennutzungen deine Einwilligung, um Informationen auf einem Gerät zu speichern und/oder abzurufen (IP-Adresse, Nutzer-ID, Browser-Informationen).
Die Datennutzung erfolgt für personalisierte Anzeigen und Inhalte, Anzeigen- und Inhaltsmessungen sowie um Erkenntnisse über Zielgruppen und Produktentwicklungen zu gewinnen. Mehr Infos zur Einwilligung gibt’s jederzeit hier. Mit Klick auf den Link "Cookies ablehnen" kannst du deine Einwilligung jederzeit ablehnen.

Datennutzungen

OTTO arbeitet mit Partnern zusammen, die von deinem Endgerät abgerufene Daten (Trackingdaten) auch zu eigenen Zwecken (z.B. Profilbildungen) / zu Zwecken Dritter verarbeiten. Vor diesem Hintergrund erfordert nicht nur die Erhebung der Trackingdaten, sondern auch deren Weiterverarbeitung durch diese Anbieter einer Einwilligung. Die Trackingdaten werden erst dann erhoben, wenn du auf den in dem Banner auf otto.de wiedergebenden Button „OK” klickst. Bei den Partnern handelt es sich um die folgenden Unternehmen:
Google Inc., Facebook Ireland Limited, elbwalker GmbH
Weitere Informationen zu den Datenverarbeitungen durch diese Partner findest du in der Datenschutzerklärung auf otto.de/jobs. Die Informationen sind außerdem über einen Link in dem Banner abrufbar.

Cookies ablehnenmehr Informationen