Data Platform Engineer
Em resumo IA
Data Platform Engineer para a equipa de Dados da Block Labs, em regime totalmente remoto e assíncrono, com preferência por sobreposição de fuso horário com a UE. Função de engenharia de pipelines de dados em tempo real e de armazém analítico para plataformas multi-tenant.
Descrição
anúncio longo (5 647 caracteres): a IA resumiu-o; o texto integral está no separador ao lado.
- Função
- Desenhar, construir e manter pipelines de dados escaláveis com AWS Glue (PySpark) ou ferramentas equivalentes. Otimizar o armazém ClickHouse para consultas em menos de um segundo. Implementar contratos de dados entre os back-offices e a plataforma. Construir a camada de serviço de features para agentes de IA. Integrar com bases de dados de terceiros, APIs de back-office e sistemas externos (CRM, afiliados, plataformas de aquisição). Estabelecer monitorização, alertas e procedimentos de manutenção. Gerir CI/CD e infraestrutura como código para cargas de dados. Colaborar com cientistas de dados, engenheiros de agentes, equipas de BI e de infraestrutura. …
- Requisitos
- Mínimo de 3 anos a construir e operar pipelines de dados em produção, em streaming e em batch
- Experiência com Apache Kafka ou Amazon MSK: desenho de tópicos, grupos de consumidores, gestão de offsets, schema registry e resolução de problemas de lag e rebalanceamento
- SQL forte e engenharia de armazéns, com experiência em bases de dados analíticas colunares (ClickHouse de preferência, ou Druid, BigQuery, Redshift)
- Proficiência em PySpark e Spark Streaming para normalizar, enriquecer e aplicar regras de negócio em streams de eventos
- Disciplina de modelação de dados para esquemas multi-tenant normalizados
- Experiência com contratos de dados e governação de esquemas
- …
- Valorizado
- experiência com AWS Glue, Apache Airflow ou Apache NiFi
- experiência em iGaming, casinos online, poker ou apostas desportivas
- experiência com fluxos de transações em blockchain ou cripto-moedas
- ambiente AWS (MSK, Glue, S3, DynamoDB, ECS, IAM)
- experiência com feature stores (SageMaker, Feast ou Tecton)
- …
- Condições
- Contrato: não indicado
- Salário: não indicado
- Horário: não indicado
- Local: remoto (regime totalmente remoto e assíncrono)
- Benefícios
- não indicados
About Block Labs
Block Labs is a premier technology studio operating at the bleeding edge of Web3, Artificial Intelligence, and iGaming. We don't just ship features; we engineer high-scale, production-grade platforms that power the next generation of digital products.
We are a collective of senior engineers, product strategists, and builders who refuse to compromise on architecture. Whether we are designing autonomous multi-agent AI systems, building decentralized financial infrastructure, or architecting high-frequency iGaming platforms, our standard is excellence.
We move fast, but we build for the long term. If you are looking to work alongside a team that values deep technical expertise, thoughtful system design, and product ownership, Block Labs is where you belong.
The Role
Data & Intelligence now sits at the centre of several products we are developing, and we need a platform that is both dependable and capable of supporting more advanced intelligence over time.
This role reflects that shift. We are designing a new data platform that will act as the backbone for everything from real time decisioning to predictive modelling. As a Data Platform Engineer in the Data Team, you will own the end-to-end real-time pipeline, serving data across a unified analytical warehouse and feature-serving layer. You are not building dashboards. You are engineering the commercial nervous system of a multi-tenant platform designed to scale from one operator to 10x with marginal infrastructure cost.
Key Responsibilities:
Design, build, and maintain scalable data pipelines using AWS Glue (PySpark), or equivalent orchestration and transformation tools.
Engineer and optimise the ClickHouse warehouse for sub-second query performance across all back-offices.
Implement data contracts between back-office and the platform. Onboarding a new operator is a config change, not new tables, topics, or feature views.
Build the feature-serving layer providing pre-computed features to AI agents at millisecond latency.
Integrate with third-party databases, back-office APIs, and external systems (CRM, affiliates, acquisition platforms).
Establish monitoring, alerting, and maintenance procedures including pipeline health checks, freshness monitoring, anomaly detection, and data contract SLA enforcement.
Own CI/CD and infrastructure-as-code for data workloads.
Collaborate with data scientists, agent engineers, BI developers, and infrastructure teams to translate data requirements into reliable, production-grade pipelines.
About You:
3+ years building and operating production data pipelines at scale, with hands-on experience across both streaming and batch paradigms.
Expertise in Apache Kafka (or Amazon MSK): topic design, consumer group management, offset handling, schema registry operations, and production troubleshooting of lag, rebalancing, and throughput issues.
Strong SQL and warehouse engineering skills: experience with columnar analytical databases (ClickHouse strongly preferred, or similar: Druid, BigQuery, Redshift).
PySpark / Spark Streaming proficiency: writing transformation jobs that normalise, enrich, and enforce business rules on event streams. Experience with AWS Glue, Apache Airflow, or Apache NiFi is a strong plus.
Data modelling discipline: ability to design normalised, multi-tenant schemas where tenant isolation is a filter, not a fork. Experience with data contracts and schema governance.
CI/CD and infrastructure-as-code experience: automated testing of data pipelines, version-controlled deployments (CloudFormation, Terraform, or CDK), and familiarity with containerised workloads (ECS Fargate or Kubernetes).
Data quality and observability mindset: experience implementing pipeline health monitoring, automated data validation (Great Expectations or equivalent), freshness checks, and anomaly detection.
Nice to Have
Experience in iGaming, online casino, poker, or sportsbook platforms.
Exposure to blockchain or crypto-native transaction flows, including on-chain event ingestion, token-denominated accounting, or stablecoin settlement.
Comfortable operating in an AWS-native environment (MSK, Glue, S3, DynamoDB, ECS, IAM). You understand serverless tradeoffs and can size infrastructure for cost efficiency.
Feature store experience (SageMaker, Feast, or Tecton) building offline/online feature pipelines that serve ML models at inference time.
Prior work in regulated industries (financial services, gambling, fintech) where data lineage, auditability, and compliance are non-negotiable.
Experience migrating legacy query engines (Athena, Trino, Presto) to modern analytical warehouses with reconciliation frameworks to validate correctness.
How We Work
Fully remote with asynchronous-first communication. EU time zone overlap is preferred.
Small, high-autonomy team within the Data function. You report to the Head of Data and co-ordinate with the AI, BI, and Infrastructure Teams.
Architecture decisions are documented and debated. You will participate in design reviews and own your domain decisions.
We build for multi-tenant scale from day one. Every pipeline, schema, and contract you ship must absorb a new operator without engineering effort.
On-call rotation will be established in the run phase. During the build phase, the focus is velocity with quality. No firefighting legacy systems.
What kind of culture can I expect?
Mature, mission-driven, and low-ego. We value clarity over noise, outcomes over theatrics, and pace without chaos. If you’re one of the smartest minds in your craft and want to build with other experts, you’ll feel at home here.
Originally posted on Himalayas
Como me candidatar
Candidatar no anúncio original ↗
Preparar candidatura
Uma carta de apresentação e uma apresentação curta para esta oferta, escritas a partir do teu perfil, e o que aprender a seguir.
Entra e cria o teu perfil a partir do CV. É privado: não o partilhamos com ninguém.
Algo errado ou ilegal neste anúncio? Reportar
Ofertas semelhantes
- Staff Software Engineer, FrontendBlock Labs
- Senior Backend Engineer (Go)Block Labs
- Staff Software Engineer, GolangBlock Labs · Lisboa
- Distributed Systems Engineer - Data Platform (Delivery, Database, Retrieval)Cloudflare · Lisboa
- Data Engineer | Azure/DatabricksCelfocus · Lisboa,Porto
- Cloud Platform EngineerBloomlife
Salário comparado ⓘ
84 ofertas · Analistas de sistemas · teletrabalho
ver as que pagam mais →Formação para esta vaga
- Advanced Architecting on AWSRumosonline · horário laboral · 21 h · 2000 € · início 09/12/2026Pedido neste anúncio: AWS
- DP-750: Implement data engineering solutions using Azure DatabricksGalileuonline · horário laboral · 28 h · 1670 € + IVA · início 14/12/2026Pedido neste anúncio: Engenharia de dados (Spark, Databricks)
- Power BI - ETL e ModelaçãoCESAE Digitalonline · pós-laboral · 9 h · 95 €Pedido neste anúncio: Engenharia de dados (Spark, Databricks)
Requisitos IA
- 3+ anos em pipelines de dados em produção
Idiomas IA
Publicado em (2)
- Himalayas visto 17 nov
- Block Labs visto 17 nov – 20 nov
Onde a empresa está ver no mapa →
- Lisboa (Lisboa) 4 oferta(s)
segundo outras ofertas da empresa; não é necessariamente o local desta oferta.
Vista pela primeira vez a 17 nov, 00:12 · última vez a 20 nov, 22:43