The worldwide data management software market is massive (According to IDC, the worldwide database software market, which it refers to as the database management systems software market, was forecasted to be approximately $82 billion in 2023 growing to approximately $137 billion in 2027. This represents a 14% compound annual growth rate). At MongoDB we are transforming industries and empowering developers to build amazing apps that people use every day. We are the leading developer data platform and the first database provider to IPO in over 20 years. Join our team and be at the forefront of innovation and creativity.

The Data Pipelines Engineering team is responsible for building ETL pipelines that populate the Internal Data Platform, which drives analytics that help the company run more efficiently. Our team builds highly performant and scalable processes that extract massive datasets and makes those datasets available for querying in an optimal way. We are also building a Generative AI framework that will help teams within the company tap into the data that we store in their Retrieval-Augmented Generation (RAG)-based applications.

We are looking to speak to candidates who are based in New York City for our hybrid working model.

What you’ll do:

• Build ETL pipelines using technologies such as Python and Spark
• Implement new ETL pipelines on top of a variety of architectures (e.g. file-based, streaming)
• Optimally store large datasets using a variety of file formats (e.g. Parquet, JSON) and table types (e.g. Iceberg, Hive)
• Work with Data Analysts and Data Scientists to understand and make available the data that is important for their analysis
• Work with our Data Platform, Architecture, and Governance sibling teams to make data scalable, consumable, and discoverable
• Leverage Cloud-based technologies (mostly AWS, some GCP) to build and deploy data pipelines

We’re looking for someone with:

• 2+ years of building ETL pipelines for a Data Lake/Warehouse
• 2+ years Python experience
• 2+ years Spark experience

Hive, Iceberg, Glue, or other technologies that expose big data as tables

• Familiarity with different big data file types such as Parquet, Avro, and JSON
• Background in building data platforms in the Cloud (e.g. AWS, GCP, Azure)
• Experience building RAG-based tools is a plus

Success Measures:

• In 3 months, you'll have collaborated with stakeholders in Data Analytics and Data Science to build your first ETL pipeline
• In 6 months, you'll have owned the delivery of a large project from start (scoping, design) to finish (delivery)
• In 12 months, you'll have designed new features, led development work, and become a go-to expert on parts of the system

To drive the personal growth and business impact of our employees, we’re committed to developing a supportive and enriching culture for everyone. From employee affinity groups, to fertility assistance and a generous parental leave policy, we value our employees’ wellbeing and want to support them along every step of their professional and personal journeys. Learn more about what it’s like to work at MongoDB, and help us make an impact on the world!

MongoDB is committed to providing any necessary accommodations for individuals with disabilities within our application and interview process. To request an accommodation due to a disability, please inform your recruiter.

MongoDB, Inc. provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type and makes all hiring decisions without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.