![Martian Profile](https://pbs.twimg.com/profile_images/1777883055933587456/GaxZvBO7_x96.jpg)
Martian
@withmartian
Followers
1K
Following
254
Statuses
139
Inventors of the model router (https://t.co/7QzBIAWycp) Understanding transformers by turning them into programs. 🤖 Our mission: https://t.co/A4VOldg6bI
Joined March 2023
Martian Raised $9M from @NEA @Prosus_Ventures and @GC and is launching its beta today! Our LLM router dynamically routes each request to the best LLM. We beat GPT-4 on @OpenAI's own evals (colab to replicate in thread) while cutting costs up to 98%+ 🧵
14
67
319
Thanks to @ForbesTech and @juliaaneagu for highlighting us in their piece on open models. These models allow us to expand our routing options, enabling our customers to achieve significant cost savings and quality improvements compared to only using closed models. By studying these open models through our interpretability research, we're constantly improving our routing methods—better understanding leads to better routing.
2
2
20
We're proud to be spotlighted by the Google for Startups program! Looking forward to a fantastic partnership with GCP: Cool to see our friends @magicailabs @MistralAI @pinecone @SakanaAILabs here too 🥰
1
5
20
Continued thoughts from @chrislmann as follow-ups to our recent article on automated prompt optimization (APO).
There are a number of automated prompt optimization (APO) techniques emerging that focus on improving the system/instruction prompt either as an activity that occurs before the prompt is put into production🚧 or a recursive feedback loop ➿that evaluates the results of the prompt and provides suggestions to improve the system prompt based on those results. This is an interesting example of the former... 🚧 Here is an article I wrote that calls out a number of real-world production use cases 🛞for APO where these techniques could potentially be applied.
0
0
3
RT @onjas_buidl: Super excited to share our work on benchmarking LLM routers at Compound AI Systems workshop at @Data_AI_Summit ! Had the…
0
5
0
RT @onjas_buidl: The best kind of paper is one where the idea is initially tricky to conceive, but once you grasp it, it seems obvious.
0
1
0
At Martian, we are fortunate to work with many of the world's most advanced users of AI. We see the problems they face on the leading edge of AI and collaborate closely with them to overcome these challenges. In this first of a three-part series, we share a view into the future of prompt engineering we refer to as Automated Prompt Optimization (APO). In this article we summarize the challenges faced by leading AI companies including @mercor_ai , @G2dotcom, @copy_ai, @autobound_ai, @6senseInc, ZeltaLabs, @EDITED_HQ, @supernormalapp, and others. We identify key issues like model variability, drift, and “secret prompt handshakes”. We reveal innovative techniques used to address these challenges, including LLM observers, prompt co-pilots, and human-in-the-loop feedback systems to refine prompts. We invite the broader AI community to collaborate with us on research in this area. If you are interested in participating, please reach out to us!
4
6
24