Machine Learning Research Engineer
New Today
About Prophecy Prophecy is the world’s most advanced data integration platform, designed to make complex data work simple and powerful. Designed natively for modern cloud data platforms, Prophecy uniquely serves the needs of business analysts while ensuring enterprise-grade governance and compliance, giving organizations the confidence to innovate. Our AI-driven platform simplifies and automates data preparation, accelerating AI and analytics across Fortune 500 companies in banking, insurance, healthcare, life sciences, and technology. By enabling secure, self-service data transformation within a robust governance framework, Prophecy empowers every data user to develop, deploy, and monitor cloud-native data pipelines with ease. Today, Prophecy supports tens of thousands of pipelines, delivering clean, trusted, and timely data at scale to power the most demanding AI and analytics workloads.
Must-Have Skills Advanced ML/LLM knowledge: hands-on fine-tuning (SFT, DPO, RLHF), distillation, quantization/pruning for model optimization.
Full ML lifecycle: from data acquisition to training to productization with PyTorch and open-source transformers (e.g., HuggingFace).
Fluency in Python for dataset/model processing.
Experience with backend pipelines/microservices software development in public cloud: AWS, k8s, java, scala.
Builder mentality: Experience taking ideas to production.
What Will Make You Stand Out ML/LLM work in code generation (e.g., Codex, text-to-SQL), semantic extraction, or knowledge graphs (e.g., Neo4j, Neptune).
Experience with big-data engines like Spark.
Optimization of ML models for low-latency, high-throughput production use.
Contributions to open-source AI/ML projects (e.g., Hugging Face, PyTorch).
Expertise in retrieval systems or vector databases (e.g., Pinecone, Weaviate).
Skill in evaluating tech and driving build/buy decisions.
Seniority Seniority: Jr to Staff Level
Experience Experience: 1+ years in industry
Compensation Compensation : $250,000–$350,000
Benefits and Perks Prophecy covers 99% of employee health insurance and 75% for dependents
We offer $200 per month towards wellness, gyms, massages, facials, and more!
Celebrate your birthday and anniversary with a day off!
Flexible PTO
Prophecy provides employees with a $500 professional development reimbursement every year
Company sponsored Long Term Disability and Life Insurance
FSA/HSA
Ability to have your fingerprint on an innovative platform
End-to-end ownership of your projects
And more!
*Benefits and perks may vary per country
Our Commitment to Diversity and Inclusion At Prophecy, we hire for merit and foster an inclusive culture where people from diverse backgrounds can excel and do their best work. We take great care to ensure that our hiring practices are inclusive and meet equal employment opportunity standards. Individuals looking for employment at Prophecy are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or expression, language, national origin, physical and mental ability, political affiliation, race, religion, sexual orientation, socio-economic status, veteran status, and any other protected characteristics under applicable laws.
#J-18808-Ljbffr
- Location:
- San Francisco, CA, United States
- Salary:
- $250,000 +
- Job Type:
- FullTime
- Category:
- Engineering