Data Engineering Manager - Ingestion and Transformation at Scale

Job Description:

At Lighthouse, we're on a mission to disrupt commercial strategy for the hospitality industry. Our innovative commercial platform takes the complexity out of data, empowering businesses with actionable insights, advanced pricing tools, and cutting-edge business intelligence to unlock their full revenue potential.
Backed by $370 million in series C funding and driven by an unwavering passion for growth, we've welcomed five companies into our journey and have surpassed $100 million in ARR in 2024. Our 850+ teammates span 35 countries and represent 34 nationalities.
At Lighthouse, we're more than just a workplace - we're a community. Collaborative, fun, and deeply committed, we work hard together to revolutionize the hospitality sector. Are you ready to join us and shine brighter in the industry's most exciting rocket-ship? 🚀
What you will do
As Data Engineering Manager, you will be leading an engineering team owning a massive-scale ingestion and transformation engine that acquires and transforms the world's hospitality data into a high-fidelity unified semantic layer. You will be responsible for building and maintaining complex data pipelines handling large data streams - to the order of 100 TB per day. This is a high-impact leadership role where you will see your team's work directly translate into real-world applications that impact hotels worldwide. The role requires you to combine strong technical experience with operational and people management excellence.
Where you will have impact
* Lead, coach, and mentor a team of data engineers, fostering a culture of technical excellence and long-term career growth.
* Be the technical guide the team can lean on for growing their technical careers and for collaborating on their technical work, while at the same time being strong with people, organization, structure, planning and driving delivery.
* (Help) drive the architecture, design, implementation, maintenance, improvements and scaling of the streaming and batch data pipelines that ingest and transform the massive volume of data powering our products.
* You will be at the forefront of our AI evolution, helping to embed intelligence into our platform. You'll not only build AI features for our customers but also champion an AI-first development culture within the engineering team.
* Identify, estimate, plan and deliver continuous improvements with the team in data quality, system stability, observability, data pipeline performance, latency, and reliability.
* Collaborate closely with product, other engineering teams, support and business teams.
About our team
You'll be leading a skilled team of data engineers who are part of our Integration Engineering business unit and who own the ingestion and complex transformations of one of the functional data domains. This team is responsible for turning massive streams of complex structured and less structured data into data products with actionable insights for the hospitality industry.

What's in it for you?
* Flexible time off: Autonomy to manage your work-life balance.
* Career development: Workshops, frameworks, and trainings to maximize your professional potential.
* Impactful work: Shape products relied on by 85,000+ users worldwide.
* Mobility options: Mobility budget or company car (based on your job category).
* Net allowance: Support for home office related expenses.
* Vouchers: Lunch vouchers & Eco vouchers.
* Comprehensive health insurance: Extensive coverage for you and your dependents.
* Pension funding: Group insurance to secure your future.
* Referral bonuses: Earn rewards for bringing in new talent.
Who you are
* You are an experienced people leader with a passion for coaching and mentoring engineers, driving their technical and professional growth.
* You have experience architecting, designing, implementing, testing, deploying and maintaining complex data architectures.
* You have a proactive, "can-do" attitude, viewing challenges as opportunities and inspiring a positive, solution-oriented mindset within your team.
* You excel at seeing the bigger picture, breaking down large architectural projects into clear, manageable tasks, and accurately estimating effort.
* You are a forward-thinking builder who views AI as a core component of modern architecture. You have a proven interest (or experience) in working with LLMs, agentic workflows, or AI-assisted coding tools to ship higher-quality code, faster.
* You get energized from optimizing structure, tooling, support and other processes.
* While this is a leadership role, you come from a strong hands-on background in data engineering or in building complex software integrations, and can act as a technical guide for your team.
* Professional proficiency in Python for large-scale data processing and pipeline development.
* Strong knowledge of data cloud technologies, data streaming systems (like Kafka or Google Cloud Pub/Sub), and cloud database solutions (like BigQuery, Snowflake, or Databricks).
* Fluency in English, with excellent communication and stakeholder management skills.
We welcome
* Experience within the hospitality technology sector or similar industries (e.g. airline industry).
Technologies you will work with
Python, Google Cloud Platform (GCP), BigQuery, Spanner, Pub/Sub, Kubernetes.

#LI-Hybrid

Thank you for considering a career with Lighthouse. We are committed to fostering a diverse and inclusive workplace that values equal opportunity for all. We welcome candidates from all backgrounds, regardless of age, gender, race, religion, sexual orientation, and disability. We actively encourage applications from individuals with disabilities and are dedicated to providing reasonable accommodations throughout the recruitment process and during employment to ensure all qualified candidates can participate fully. Our commitment to equality is not just a policy; it's part of our culture.
If you share our passion for innovation and teamwork, we invite you to join us in shaping the future of the hospitality industry. At Lighthouse, our guiding light is to be an equal opportunity employer, and we encourage individuals from all walks of life to apply. Not ticking every box? No problem! We value diverse backgrounds and unique skill sets. If your experience looks a little different from what we've described, but you're passionate about what we do and are a quick learner, we'd love to hear from you.
We value the unique perspective and talents that you bring, and we're excited to see how your light can shine within our team. We can't wait to meet you and explore how we can grow and succeed together, illuminating the path towards a brighter future for the industry. #LI-Hybrid