Machine Learning Scientist I/II, Multi-Modal Scientific Reasonings

What this role involves

This role focuses on advancing multi-modal reasoning with vision-language models on scientific data. The scientist will lead research, design training methods, build datasets, and develop perception modules. Collaboration with domain scientists and engineers is expected.

Skills this posting asks for

• multi-modal machine learning
• vision-language models
• scientific qa/benchmarks
• custom evaluation design
• multi-modal fine-tuning
• document parsing and understanding
• dataset curation
• benchmarking
• pytorch
• huggingface
• instruction tuning
• supervised learning
• rlhf
• rag
• ocr
• table/structure recognition
• plot parsing
• scientific data modalities
• microscopy images

Requirements

• Level: mid

From the employer’s posting

Your Impact at LILA We’re hiring a Machine Learning Scientist to advance multi‑modal reasoning with vision‑language models (VLMs) on real-world scientific data including, but not limited to: figures and plots, microscopy data from diverse sources. You’ll design and build…