Role Overview
Spellbrush is a generative AI studio behind nijijourney, seeking a Generalist Software Engineer to help build advanced data pipelines, foundational datasets, and the tools and infrastructure that support them.
Responsibilities
- Define processes and infrastructure to transform and make data readily available across the company, including embeddings, video, and bounding boxes.
- Partner with AI researchers to understand needs and design, build, and monitor scalable pipelines that meet today's requirements and can gracefully scale with growing data.
- Design, build, and monitor batch jobs and data solutions that scale with growing data.
Requirements
- Self-starter who can work directly with the research team to gather and synthesize high-impact needs, designing and implementing technical solutions, and communicating deliverables, timelines, and tradeoffs.
- Spent 3+ years as a software engineer with a wide generalist skillset.
- Worked with distributed systems and previously administered a big data toolset such as Ray, Spark, or Airflow.
- Hands-on experience shipping scalable data solutions in the cloud, such as AWS, GCP, or Azure, across multiple data stores such as Snowflake, Redshift, Hive, or SQL/NoSQL.
- Comfortable pulling data from any source, writing complex SQL queries, or coordinating large data transfers.
- Highly comfortable with scripting in Typescript, Python, or Bash.
- Most importantly, you know when to pull in complex overengineered tools, and when to instead rely on duct tape.