PromptLayer
@promptlayer
Followers
3,519
Following
274
Media
75
Statuses
440
The first platform for prompt engineering. Collaborate, manage, and evaluate prompts. 🍰
NYC
Joined March 2022
Don't wanna be here?
Send us removal request.
Explore trending content on Musk Viewer
Bama
• 101297 Tweets
jaemin
• 91789 Tweets
スプリンターズS
• 65795 Tweets
Ryan Williams
• 43986 Tweets
Riquelme
• 43174 Tweets
Milroe
• 29679 Tweets
Carson Beck
• 27180 Tweets
Jeremiah Smith
• 22830 Tweets
#صباح__الخير
• 21971 Tweets
スプリンターズステークス
• 20577 Tweets
招き猫の日
• 18062 Tweets
Utah
• 17869 Tweets
ジンギスカン
• 14519 Tweets
Chivas
• 13162 Tweets
ショアキーパー
• 12802 Tweets
サトノレーヴ
• 11599 Tweets
#RIZIN48
• 10522 Tweets
ママコチャ
• 10514 Tweets
VBall PlayerJustin
• 10264 Tweets
YINWAR POLYPLUS CH3
• 10142 Tweets
ピーニャ
• 10039 Tweets
0
6
44
🪩 New Analytics Page 🪩
Now you can track and visualize:
1. Cost 💰
2. Latency 🏎️
3. Model Usage 🤖
4. Prompts 📃
Great for teams, we all know that one person who will live on this page! 🍰🍰🍰🍰
1
3
36
PromptLayer is hosting the 1st ever Prompt Engineering Tournament 🏆
Come for pizza, beer, and good company.
Compete to win a
@rabbit_hmi
r1 and the admiration of your peers 🐰
See you at the beautiful
@Company
amphitheater on March 12th.
3
7
32
Big news... PromptLayer now fully supports
@MistralAI
models.
Open-source language models are seriously good. Try them out today in through the Playground, evals, or logs.
open-mistral-7b
open-mixtral-8x7b
mistral-small-latest
mistral-medium-latest
mistral-large-latest
5
6
28
If you didn't hear, the new
@OpenAI
models let you define functions in your prompt and reliably get JSON responses to call said functions.
And best of all... the new function types are fully supported in PromptLayer 🍰
See more at
0
2
20
🏃♂️Search and Speed updates 🏃♂️
Our dashboard loads 10x faster and search is now optimized for big accounts.
0
3
20
📣 PromptLayer now supports Claude-100k 📣
One line of code to start tracking & monitoring your
@AnthropicAI
app
❌ client = anthropic.Client
✅ client = promptlayer.anthropic_client
Set it up in <5 min ✨
3
3
18
A lot of customers have told us they are working on migrating their prompts from
@OpenAI
to open source models like
@MistralAI
So we wrote up a guide on how to do it. Check it out 🫡
0
4
17
We are cohosting a NYC event with
@arizeai
in a few weeks!
@Jonpon101
will be talking about building LLM systems with one of our favorite customers
@RogoData
🍰
Don't miss it if you want to learn how to build LLM applications (in real world businesses not just academic papers)
3
2
17
Fine tuning might just be the future. (now that it's available for
@OpenAI
gpt-3.5)
It's easier than ever to use PromptLayer to prepare some fine tuning training data. Just click the export button in the search bar!
Filter export json by tags, query, or metadata ✨🕺
1
4
14
Bunch of new features coming out this week around prompt templates. Systematic prompt engineering.
🍰 Prompt update commit messages
🍰 Prompt release labels
More info in thread below 🧵
4
4
14
🪩 Feature Friday 🪩 You can now programmatically access older versions of prompts through our Python library and our API
1
0
14
One of the most commonly asked for features!
Great for PMs, SREs, and generally understanding user & agent behavior
The next phase in
@promptlayer
’s master plan..
🔭 User event & agent analytics 🔭
Every request can now be tagged with user behavior & agent metadata.
Stop jerry-rigging Mixpanel & Segment in your LLM stack. Commonly requested feature from the PMs and SREs using PromptLayer.
5
8
44
0
1
13
Our long awaited Javascript library is now out!!
`npm install promptlayer`
Learn more on the docs 🫡
2
3
13
🪩 Feature Friday 🪩 we just added better UI support for chat type completions
1
2
12
PromptLayer now has a "Forgot Password"
Too much fun building cool features for you but figured it's about time for this one 😜
3
1
11
It is super easy to test out the new
@AnthropicAI
Claude 3 models on PromptLayer! 🍰
All you need is to take your prompt template to the evals page and select either of the new models! You can then compare the results with any other model on PromptLayer.
1
2
11
Available now in the PromptLayer playground, registry, and evals. Happy prompting 🫡
New
@Google
developer launch today:
- Gemini 1.5 Pro is now available in 180+ countries via the Gemini API in public preview
- Supports audio (speech) understanding capability, and a new File API to make it easy to handle files
- New embedding model!
107
252
2K
1
2
11
📣We have added
@OpenAI
Functions to our Prompt Registry! You can now create prompt templates that have functions in them! 🎉
Read more in our docs
0
1
10
Thanks for the shoutout on Forbes, Michelle!
There is a lot of complexity and work to be done to stand-out in the AI world to come. Prompt engineering is the process 🍰
@Forbes
@ForbesTech
@CatalyzingInnov
4
2
10
📣PromptLayer now supports gpt-4-vision and dalle-3🎉🍰
No update required on your end!
1
2
10
UPDATE: We just made it even simpler to use
@AnthropicAI
.
Make sure to use the one line code swap below:
❌ import anthropic
✅ anthropic = promptlayer.anthropic
📣 PromptLayer now supports Claude-100k 📣
One line of code to start tracking & monitoring your
@AnthropicAI
app
❌ client = anthropic.Client
✅ client = promptlayer.anthropic_client
Set it up in <5 min ✨
3
3
18
1
2
10
Check out our favorite prompts from the tournament..
We combed 🪮 through every prompt submitted (list in the appendix) and found the prompt engineering strategies that were most effective.
Thanks to
@pranav_kanchi
for the writeup.
0
1
10
🧑💻🧑💻🧑💻
2
2
10
New bio...
Credit to a customer discovery call today where our product was described as "data-driven prompt engineering". Love it 🙏
0
1
10
Just dropped a new example tutorial. Search recipes!
Build a recipe recommendation bot using:
✨
@OpenAI
for models
🌲
@Pinecone
for vector storage
🍰
@PromptLayer
for prompt engineering
Many of our users have RAG workflows, so this should help!
0
5
10
🧵 On Prompt Routers
The naive approach to building a chatbot: big monolith prompt
The better approach: prompt router + modular task-specific prompts
1
0
9
We just added support for Llama3 on PromptLayer.
@AIatMeta
📈📈📈
You can run use the playground, run evals, and compare it against GPT-4.
The top 20 open source LLMs are now on PromptLayer 🍰
Thanks to
@CloudflareDev
for making this so easy!
0
3
9
Join us next week for this event! Our very own co-founder
@Jonpon101
will be hosting a panel with Tumas Rackaitis of
@RogoData
Join us in NYC Sept 7 for Building LLM-Powered Systems that Work in the Real World 🙌
Speakers from
@TCVTech
@promptlayer
@bentomlai
@pinecone
@llama_index
@Bazaarvoice
@RogoData
Panels, demonstrations, and networking opportunities!
SAVE YOUR SEAT:
0
1
5
0
1
7
Hosted our first happy hour! Thanks to everyone who came 💪
Successful
@MagnivApp
happy hour last night with some amazing NYC founders, engineers, and data scientists 🔥🍻
(hmu for an invite to the next one 📆 thanks to all that came!)
0
0
7
0
0
8
Yes.... we know creating
@OpenAI
function schemas is annoying. Use our new function dialogue to build the schema interactively 🦾
1
2
7
We'll be releasing some guides on the subject soon. In the meantime, you know where to find us.
PromptLayer seamlessly allows test-driven prompt engineering. Or should we say eval-driven...
1
3
7
Try out Claude 2 with PromptLayer!
Introducing Claude 2! Our latest model has improved performance in coding, math and reasoning. It can produce longer responses, and is available in a new public-facing beta website at in the US and UK.
163
518
2K
0
1
7
ParentLab is revolutionizing parenting support through the product Era's AI-powered conversations that provide timely, personalized guidance to parents.
PromptLayer's visual prompt CMS allows
@ParentLab
's educators to rapidly iterate on the AI's voice, no technical background
0
1
7
We just pushed a huge docs overhaul 📣📣📣
New getting started tutorial & tons more code snippets
2
3
7
LLaMA2 is live 👀👀👀
✨NEW LAUNCH! LLaMA2 chat API & open-source playground💫:
We're releasing tools that make it easy to test
@meta
's latest LLM & add it to your own app with
@replicatehq
.
Playground:
Live chat API here:
Repos & instructions below:
52
234
1K
1
2
6
🎉🎉🎉
Big news!
You can now use
@promptlayer
with
#CodeGPT
and start logging all interactions with
@OpenAI
models
1
1
2
0
1
5
Our talk with
@RogoData
on how they use PromptLayer to build a RAG application at scale 🍰
Some amazing insights by their CTO on prompt engineering & prod language models.
0
3
6
NY tech week off to a great start! Gave a demo along with
@GocharlieAI
and
@CamcorderAI
for some marketing tech folks 🍰
0
2
6
📢 PromptLayer is now on Discord 📢
Join our discord community to ask questions, learn from peers, and hear about our product roadmap!
1
0
6
Some new updates to our Prompt Registry page....
Pagination & more
Also our newest engineer Nahuel's first commits 🙏🎉
1
2
6
Quick update! You can now attach model parameters to prompt template versions 🙏
0
1
5
🚨 Building your own ChatGPT 🚨
Amazing new tutorial on
@thenewboston_og
. Takes you from a blank slate to building your own personal ChatGPT.
Emphasizes all the best practices of prompt engineering. Great watch 🍰
0
2
5
Part 2 of the tutorial is out!
Adding world information to your chatbot 🫡
🚨 Building your own ChatGPT 🚨
Amazing new tutorial on
@thenewboston_og
. Takes you from a blank slate to building your own personal ChatGPT.
Emphasizes all the best practices of prompt engineering. Great watch 🍰
0
2
5
0
1
5
Best practices in prompt management and collaboration. Read more below.
❌ Prompts in code
✅ Prompts in CMS
❌ Monolith system messages
✅ Modular prompt snippets
0
2
5
🚨 New feature alert 🚨
Chain Magniv tasks together and trigger a new task on successful completion.
Learn more at
0
1
4
Prompt inheritance. This is great way to modularize your master prompt into a bunch of re-usable snippets ✂️
1
1
5
Prompt engineering is a delicate balance between automation and human labor. When done right, the right tweak of a prompt can be more important than months of regular coding.
1
1
5
Today, we are entering a new era.
The emergence of GPT-3 and Deep Learning has broken the traditional approach to Artificial Intelligence.
Innovation comes from hackers, no longer from researchers.
0
1
5
We now support function calling from
@AnthropicAI
Was so easy to implement because of our model-agnostic prompt schema refactor 🤓
0
0
5
Cool article on the AI Stack by
@MongoDB
and
@richmondalake
Love the PromptLayer shout out!
AI is collaborative. Couldn't agree more.
0
2
5
As a reminder... using PromptLayer with
@OpenAI
also takes one line of code.
❌ import openai
✅ openai = promptlayer.openai
0
2
5
Make sure to update promptlayer through pip before trying this 🫡
🍰⛓ Big news. You can now use
@promptlayer
with
@LangChainAI
Langchain speeds up development by 10x.
Promptlayer speeds up debugging by 10x.
Start using them together with one line.
1
3
43
0
1
5
You can now request more resources through our task decorator.
It is as simple as adding a resource dictionary with your desired cpu and memory needs.
0
2
4
0
0
5
🍰🚨🍰
🚨
@promptlayer
update: We added versioning to our PromptRegistry 🍰!
Now you can see your old prompts and track how they improve 🕺
2
3
15
1
1
5
Monolithic prompts are simple to build. But are not a good idea if you expect long conversations.
Every new user message will be appended. Every new AI response will be appended.
Longer prompt ➡️
Longer context window ➡️
Slower & more expensive responses ⌚️ 💰
1
2
5
It's not a hackathon without PromptLayer cakes
@ahiajsbwks
@proofofbeef
@hackgoofer
Team working towards sponsors' outcomes
🤝
Sponsors bringing their A-Game to the event.
Thanks
@AnthropicAI
@modal_labs
@praxisnation
@AntimetalCloud
@huggingface
@JoinPasses
@Meta
@promptlayer
@LastMile
@AntimetalCloud
@nomic_ai
@HF0Residency
@EverywhereVC
1
2
5
0
1
5
🍰 x ⛓️🦜
🚨 PR to add
@promptlayer
support for `ChatOpenAI` on
@LangChainAI
has been merged! Should be on the
@LangChainAI
python library soon!
1
1
10
0
0
5
“The first reaction with prompts is that really relying on them in your codebase as much as you do source code will be kind of hacky and fragile”
We agree. Prompts belong in the Registry.
The (now routine!) presence of a prompt in the middle of a pipeline that achieves state-of-the-art (as in the study below) is what “prompted” this post.
The first reaction with prompts is that really relying on them in your codebase as much as you do source code will be kind of
9
10
152
0
2
4
Lots of new Playground updates on PromptLayer!
🌊 Streaming
🔬 Input variable parsing
0
2
4
We believe that prompt engineering should be collaborative. PromptLayer now supports workspaces ✍️
Start inviting teammates today
0
1
4
read more in our docs:
0
0
4
Classic PromptLayer workflow:
1. Click on an LLM log
2. Open it in Playground
3. Re-run it on a new model
Here we are using
@Google
's new Gemini Flash (s/o
@OfficialLoganK
)
0
3
3
We were our first customer! Thanks for the spotlight
@GregKamradt
Like many good beginnings,
@imjaredz
and his co-founder built
@promptlayer
because they desperately needed it for themselves
Super interesting to chat with him about how teams (including non-technical PMs) iterate on prompts via PromptLayer
Here's the full conversation
2
7
27
0
0
3
Why data scientists shouldn’t try to act like software engineers. What is missing in the Modern Data Stack...
0
1
4
💪
0
0
4
# ON PROMPT DATASETS
Datasets are an underrated but integral part of the prompt engineering process.
And no, not in a traditional ML "data is your moat" way. Datasets are not your moat, but building a really good end-to-end AI product is hard and differentiating.
You are
0
1
4
You can now spin up a Redis instance on your workspaces in Magniv! 🎆
You can use this as an artifact store to keep track of data you are working with and pass data between tasks.
Check out our documentation here:
0
2
3
With prompt engineering, the possibilities are endless! What kind of prompts have you built lately?
#promptengineering
🚀
3
0
4
Building ChatGPT from scratch, with best practices
ChatGPT is a simpler app than you would expect. In this tutorial we will build our very own personal ChatGPT.
➡️ With a special emphasis on prompt engineering best practices!
0
2
4
DM us for an invite to the next one 👀
Held our second
@MagnivApp
happy hour last night 🎉 Love the NYC data community always a great time 🔥🔥🔥
0
2
10
0
0
3
The only think that is a little more tricky is short-term memory.
You'll have to manually inject summaries into the context.
Learn more
0
0
3
@AnthropicAI
We updated the API. Use promptlayer.anthropic instead
UPDATE: We just made it even simpler to use
@AnthropicAI
.
Make sure to use the one line code swap below:
❌ import anthropic
✅ anthropic = promptlayer.anthropic
1
2
10
0
1
3
Set up a webhook trigger for any Magniv task with just one boolean parameter!
Learn more at
0
1
2
💬 First up, prompt version commit messages.
Optional but a much requested feature.
1
1
3
NYC hackathon scene is amazing. Happy to sponsor
This weekend at
@JoinFreeAgency
HQ:
We've partnered w/ students at
@cornell_tech
to throw HackGPT, an LLM hackathon co-sponsored by
@huggingface
,
@AnthropicAI
, Coatue,
@promptlayer
,
@SamsungNext
,
@IBM
,
@StabilityAI
,
@Swayable
,
@nomic_ai
,
@happy_scribe
,
@graphext
, &
@warpdotdev
.
3
4
18
0
0
3
Should be fun!
Speaking at a cool conference on LLMs in production next week...
Signup! 🍰
1
0
19
0
0
3
🥳👀 Can't wait to share what we've been cooking up over the next few weeks! 🍳🍳🍳
0
0
3