Generative AI - ML System Engineering

Generative AI - ML System Engineering WHO YOU ARE We are looking for Machine Learning Systems Engineers who can help us build the world's largest end-to-end 3D native machine learning systems. You will help us build our end to end ML framework dedicated for 3D, from pretraining, to finetuning, inferencing, etc. We expect a combination of strong hands on engineering skills, eagerness to learn new things, and thrives in a fast-paced, high-ownership environment. WHO WE ARE At Meshy, we believe 3D creation should be boundless and accessible. Our mission statement is simple: unleash creativity. We built a full pipeline for 3D content ranging from text / image to 3D, texturing, texture editing, animation rigging, etc. We also built a vibrant community for our creators, where people can share their work, take inspiration from others, and even use it as an asset marketplace for their games and prototypes. We are the market leader in 3D generative AI, recognized as the No.1 in popularity among 3D AI tools (according to 2024 A16Z Games survey), and we generate real value and is used by enterprises (including Meta, Square Enix, Deepmind, etc.) and millions of end users. Meshy is used in game and film production, in 3D printing, in industrial product design, in enablement of novel product features such as user-generated content, and even in training and simulation for robotics and physical AI. YOUR NEXT CHALLENGE 3D is the brave new frontier of Gen AI. Our work here involves a lot of unique new challenges in both training and inference. Your next challenge at Meshy would involve the full stack of AI, from debugging and monitoring the hardware platform, building training framework, scaling high-throughput 3D data pipelines for our foundational training, co-designing novel model architectures with researchers, to the novel challenge of efficient inference engines for diffusion models and more. Here are some examples for each side of the challenge: On the training side - Work closely with researchers to co-design the next frontier of 3D & Spatial AI. - Build and debug on top of modern PyTorch, for maximum parallelism and efficiency, and build clean and intuitive training infrastructure for our in-house foundational models. - Identifying bottlenecks and optimizing for high throughput & efficient distributed model training across hundreds to thousands of GPUs. - Implementing and maintaining 3D specific custom operators in Triton or CUDA. - Implementing and maintaining novel data-loading framework and libraries. On the inference side - Building efficient inference endpoints with complex multi-stage model pipelines. - Optimizing models through compilation, fusion, quantization, etc. WHAT WE'RE LOOKING FOR - Experience in machine learning or high performance graphics. - Solid practical understanding of at least one machine learning framework (e.g. PyTorch, JAX). - Strong ability to write beautiful and maintainable code in Python and/or C++. - Ability to learn fast and dive into new concepts or complex codebases. - Performance and efficiency oriented mindset, with a strong interest in the tiniest detail. - Strong communication skills for working in a globally distributed team. NICE TO HAVE - A strong passion to navigate through the PyTorch internals, with hands-on experience in areas like torch.compile , fully_shard (FSDP2) APIs. - Experience with building Triton kernels. - Experiences with large-scale distributed training, familiarity with modern parallelization techniques: DP, TP, CP, PP, zero redundancy optimizers, etc. - Experience with diffusion models in 3D or video. - Experience with low precision bf16 or fp8 training. A LITTLE MORE ABOUT MESHY.AI Trusted by Meta, Square Enix, Deepmind and more, Meshy is redefining 3D creation with generative AI. We empower artists, designers, engineers, hobbyists, and makers to bring immersive worlds, characters, and experiences to reality in minutes instead of months. In add ... (truncated, view full listing at source)