colours
radaremprego

Senior Data Engineer

Hoursnot stated in the ad
not stated in the adwork mode · contract · salary
posted 2023-09-04 · advertised for 1173 days

In short AI · a number was not found in the ad

Senior Data Engineer at Loka, a globally distributed tech consultancy based in Silicon Valley. 100% remote role designing and implementing data solutions, from batch to streaming, at scales from megabytes to petabytes.

Description

a long ad (4 994 characters): the AI summarised it; the full text is in the next tab.

Role
Design, implement and scale data solutions, from batch to streaming, for Loka's clients. Build production-grade data pipelines and real-time data streams, lead technical projects from architecture to implementation, and gather technical and business needs from clients. Collaborate with Machine Learning, Data Science, Design, Software Engineering and Business teams, build tests and health checks, and monitor data with dashboards and visualizations.
Requirements
  • Advanced Python and advanced SQL
  • Experience in ETL design, implementation and maintenance
  • Experience with AWS (preferred), GCP or Azure delivering data-centric products
  • 5+ years of experience in a similar role
  • Experience with in-memory and disk-based databases, relational and non-relational databases, and full-text search engines (e.g. MySQL, MongoDB, OpenSearch, DynamoDB)
  • Experience with data warehousing and multidimensional data models (columnar data modelling)
  • Working knowledge of Data Lake, Data Warehouse and massively parallel processing
  • Strong problem-solving ability and ability to work through ambiguity and incomplete specifications
  • Excellent English; CV in English
Preferred
  • IAM, federated authentication, SSO, SAML, encryption, security, APIs, disaster recovery or backup; distributed systems for large-scale data processing; Spark and Pandas; open table formats (Hudi, Delta Lake, Databricks, Iceberg); Infrastructure as Code and CI/CD pipelines; QuickSight and DataViz; graph databases (e.g. Neo4j)
Conditions
Contract: not stated
Salary: not stated
Hours: remote (100% remote); every other Friday off
Location: remote
Benefits
  • Every other Friday off (26 extra days off a year)
  • Paid sick days and local holidays
  • Explore and Relocation programme (three months working abroad or full international relocation)
  • Business English classes programme
  • Continuous learning support
  • Fitness and/or mental health subscriptions
  • Access to LokaLabs™, the internal R&D programme
  • Defined career path

Years from now, history will look back at this moment as a landmark for the human race—the moment when generative artificial intelligence began to change everything. Luckily, you happen to be living through it. Now what?

If you’re one of those rare people driven to add their intellectual energy to the relentless momentum of technological advancement, consider Loka your optimal leverage point.

Loka is a globally distributed tech consultancy based in Silicon Valley, and we’re seeking a Senior Data Engineer to join our growing team. In this role you will design, implement and scale data solutions from batch to streaming, dealing with the low-latency requirements of a few megabytes up to several petabytes. You will be an evangelist of good practices and dwell at the cutting edge of new technologies and architectural patterns. Ultimately we expect that you will not just fit in with our Data crew but elevate it to new heights.

We help our clients launch innovations that fix the climate, defeat cancer, improve agricultural efficiencies, teach kids to read and more. We work with all kinds of companies, from Silicon Valley startups to major household brands, always guided by our fundamental belief that mission matters. We count more than 200 certified specialists, technical experts and PhDs among our colleagues—committed Lokals who contribute to their brilliance not only to serving our clients but to mentoring junior colleagues as well. We work entirely remotely, test new ideas with our in-house incubator and take every other Friday off (really).

To cap it off, at the end of 2024 Loka was recognized by AWS as Innovation Partner of the Year, beating more than 150,000 partners for the title.

We’re as proud of our culture as we are of our projects. You will be too. Join our team, feed your need to grow and ship projects you believe in with a team you’re proud to be a part of.

The Role

  • Build scalable production-grade data pipelines and real-time data streams.
  • Write and design scalable, cloud-ready applications.
  • Lead technical projects through architecture, design and implementation phases.
  • Engage with clients to understand their business and technical needs, evaluate potential solutions, and define high-level implementation approaches and estimates.
  • Collaborate with Machine Learning, Data Science, Design, Software Engineering and Business teams to triage data or ETL issues.
  • Build tests and health checks to maintain code and data quality.
  • Monitor and analyze data flowing through various systems by adding appropriate visualizations and dashboards.
  • Contribute to internal engineering initiatives and projects, helping identify opportunities for improvement, evaluate solutions, and drive their implementation.
  • Provide updates and offer guidance to clients.

Technical Requirements

  • Advanced Python and SQL
  • Experience in ETL design, implementation, and maintenance.
  • Experience in AWS (preferred), GCP, or Azure delivering data-centric product experiences
  • 5+ years experience in related role
  • Experience with in-memory and disk-based databases, relational and non-relational databases, full-text search engines, database design, development, and maintenance. (Such as MySQL, MongoDB, OpenSearch, and DynamoDB, with bonus for Graph Databases like Neo4j)
  • Experience with data warehousing and multidimensional data models (columnar data modeling)
  • Working knowledge in Data Lake, Data warehouse and massive parallel processing
  • Strong problem-solving ability and ability to work through ambiguity and incomplete specifications

Preferred but Not Required

  • Working knowledge in IAM, Federated Authentication, SSO, SAML, Encryption, Security, APIs, Disaster Recovery or Backup
  • Strong ability in distributed systems for large-scale data processing
  • Experience with Spark and Pandas
  • Experience with Open Tables (Hudi, Delta Lake, DataBricks, Iceberg as related to Data Lakehouse)
  • Experience with Infrastructure as Code and CI/CD Pipelines
  • Experience with QuickSight and DataViz

Additional Requirements

  • Excellent English - Being a global team, we work entirely in English for meetings, customer calls and business communications
  • CV written in English

Personality Profile

  • Curious: You strive to learn and grow into different industries with a modern tech stack.
  • Autonomous: You thrive in a fully remote, globally distributed team.
  • Collaborative: You enjoy working across departments.
  • Adaptable: You operate with a startup mindset and move at startup speed.

Benefits

  • Every other Friday off (26 extra days off a year)
  • Remote-first culture
  • Explore and Relocation programs (three months work abroad or full international relo)
  • Paid sick days and local holidays
  • Business English classes program
  • Continuous Learning Support
  • Fitness and/or Mental Health Subscriptions
  • Access to LokaLabs™, our internal research and development program
  • Defined career path

Your achievements matter to us! Ensure your CV and LinkedIn and GitHub profiles are up to date and accurately reflect your experience.

How to apply

Apply on the original ad ↗

Prepare your application

A cover letter and a short pitch for this job, written from your profile, and what to learn next.

Sign in and create your profile from your CV. It is private: we share it with no one.

Something wrong or unlawful in this ad? Report it

It stays visible while we review it. We decide within 7 days (anything clearly unlawful, such as a scam, sooner) and tell you the outcome and why.

Similar jobs

Salary compared ⓘ

OfferedMedian?3 077 €
2 569 €4 777 €

50 jobs · Systems analysts · remote

see the best paid →

Training for this job

Languages AI

Published on (1)

First seen on 19 Nov, 15:45 · last seen on 19 Nov, 23:27