Big Data Infrastructure Engineer
In short AI
Big Data Infrastructure Engineer owning the international big data platform as technical lead, operating HDFS, Apache Ozone and Iceberg, and rebuilding monitoring and alerting. Remote work, GMT+3 time zone (up to 3 hours difference).
Description
- Role
- Owns the big data infrastructure of the international platform and acts as its technical lead. Deploy, upgrade and operate the core services HDFS, S3-compatible object storage (Apache Ozone), Iceberg and others. Lead a pilot that turns a few very large datasets into thousands of small tables, introduce compute and storage quotas for business units, migrate from the default Iceberg catalog to Lakekeeper or Gravitino, and rebuild monitoring and alerting. Work closely with an engineer who runs the same stack in a parallel contour.
- Requirements
- 5+ years designing, deploying and operating big data platforms
- Hands-on experience with HDFS / Hadoop: deployment, version upgrades, troubleshooting
- Hands-on experience with S3-compatible object storage (Apache Ozone, MinIO or similar)
- Experience with Apache Iceberg
- Experience with monitoring and alerting for data infrastructure
- English B2
- Ability to work in the GMT+3 time zone (up to 3 hours difference)
- Preferred
- Trino, Kafka or Flink; Iceberg REST catalogs (Lakekeeper, Gravitino, Polaris or similar); resource quotas and cost allocation in multi-tenant platforms; hands-on use of AI tools (Copilot or agents)
- Conditions
- Contract: not stated
- Salary: not stated
- Hours: not stated (remote work, flexible schedule)
- Location: remote
- Benefits
- Flexible schedules and remote work
- Structured onboarding, personal development plan and regular internal lectures and demos
- Internal programs for adaptation, training, soft skills and leadership
- Partial compensation for external training and conferences
- Corporate English school with group and individual lessons
- Corporate prices on hotels and travel
- Extra non-working day (MyTime Day Off) without loss of pay
As a Big Data Infrastructure Engineer in the Big Data Platform team, you’ll own the big data infrastructure of our international contour and be its technical lead. You’ll deploy, upgrade and operate the core services of the platform: HDFS, S3-compatible object storage (Apache Ozone), Iceberg and others. You’ll start by helping run an infrastructure pilot that changes how the platform is used: a small number of very large datasets will become thousands of small tables. You’ll introduce compute and storage quotas for business units, migrate us from the default Iceberg catalog to a more capable one (Lakekeeper or Gravitino), and rebuild monitoring and alerting so alerts mean something again. You’ll work closely with an engineer who runs the same stack in a parallel contour. You’ll share approaches and solutions with them and cover for each other. Our infrastructure runs on the latest versions of everything, and we actively replace outdated tools. The role suits an experienced engineer who wants real ownership and a big say in architecture.
Requirements
- 5+ years of experience designing, deploying and operating big data platforms.
- Hands-on experience with HDFS / Hadoop: deployment, version upgrades, troubleshooting.
- Hands-on experience deploying and operating S3-compatible object storage. Apache Ozone is ideal, but MinIO or similar solutions also count.
- Experience with Apache Iceberg.
- Experience setting up monitoring and alerting for data infrastructure.
- English B2.
- Ability to work in the GMT+3 time zone (up to 3 hours difference).
Nice to have
- Experience with Trino, Kafka or Flink.
- Experience with Iceberg REST catalogs (Lakekeeper, Gravitino, Polaris or similar).
- Experience setting up resource quotas and cost allocation in a multi-tenant data platform.
- Hands-on use of AI tools, such as Copilot or agents, to speed up your work.
Benefits
- Flexible schedules and opportunity to work remotely.
- Ambitious and supportive team who love what they do, appreciate each other, and grow together.
- A structured onboarding, a personal development plan, and regular internal lectures and demos from the team.
- Internal programs for adaptation and training, development of soft skills, and leadership abilities.
- Partial compensation for participating in external training and conferences.
- Corporate English school: Group and individual lessons, speaking clubs with colleagues from all over the world.
- Corporate prices on hotels and travel services.
- MyTime Day Off - an extra non-working day without loss of compensation.
Originally posted on Himalayas
How to apply
Prepare your application
A cover letter and a short pitch for this job, written from your profile, and what to learn next.
Sign in and create your profile from your CV. It is private: we share it with no one.
Something wrong or unlawful in this ad? Report it
Similar jobs
- Senior Big Data & Time-Series Infrastructure EngineerEER Poland
- Senior Big Data Infrastructure Specialist – Banking IndustryITDS Portugal · Lisboa
- #111 - Data EngineerLifted (an Upwork Company)
- Infrastructure Platform Engineer (Linux & Virtualization) – Remote (EMEA) (f/m/dSecurityBridge
- Infrastructure Engineeract digital · Lisboa
- Big Data Engineer – Spark/ScalaShore · Lisboa
Salary compared ⓘ
86 jobs · Systems analysts · remote
see the best paid →Training for this job
- Pós-Graduação Online em Data Analytics & Big DataUniversidade Europeiaonline · 35 weeks · starts 03/2027Asked for in this ad: Data engineering (Spark, Databricks)
- DP-750: Implement data engineering solutions using Azure DatabricksRumosonline · daytime · 28 h · 1670 € · starts 14/12/2026Asked for in this ad: Data engineering (Spark, Databricks)
- Hadoop FundamentalsGalileuonline · daytime · 18 h · 1080 € + IVA · starts 02/12/2026Asked for in this ad: Data engineering (Spark, Databricks)
Languages AI
Published on (1)
- Himalayas seen 16 Nov
First seen on 16 Nov, 22:59