Deepti Raghavan Profile
Deepti Raghavan

@deeptir18

Followers
754
Following
193
Media
5
Statuses
43

Assistant Professor of CS at Brown

Providence, RI
Joined June 2011
Don't wanna be here? Send us removal request.
Explore trending content on Musk Viewer
@deeptir18
Deepti Raghavan
3 months
I'm very excited to be starting at @BrownCSDept this fall!
@BrownCSDept
Brown CS
3 months
Please welcome Deepti Raghavan, joining us this fall as assistant professor! A recent graduate of @Stanford , her research interests focus on operating systems, networking, and machine learning systems:
Tweet media one
1
6
82
25
20
426
@deeptir18
Deepti Raghavan
2 years
Stanford CS is running an application support program for underrepresented students. If you’re considering applying to the Computer Science PhD program at Stanford, we'll do our best to give one round of feedback on your application. Apply by October 29:
4
127
359
@deeptir18
Deepti Raghavan
8 months
We’re excited to share our ongoing work on ALTO, a network orchestrator for efficiently serving compound AI systems. ALTO can improve serving throughput for a complex chatbot verification pipeline by 3x while reducing tail latency by 1.8x.
Tweet media one
1
11
49
@deeptir18
Deepti Raghavan
3 months
I will be recruiting PhD students this upcoming cycle, to start in fall of 2025. Please apply if you are interested in operating systems, networking or machine learning systems.
2
0
18
@deeptir18
Deepti Raghavan
3 months
I am extremely grateful to my family, friends, collaborators and mentors -- @matei_zaharia , Phil Levis, and @schemeprincess -- for helping me get to this point. Thank you for making my PhD both fun and rewarding!
2
0
8
@deeptir18
Deepti Raghavan
8 months
Generative language models emit tokens incrementally, which is especially useful in the context of compound AI systems because we can stream partial outputs between pipeline stages to overlap computation.
Tweet media one
2
0
6
@deeptir18
Deepti Raghavan
8 months
Many compound AI systems combine generative LMs with external tools like retrievers in a pipeline to solve challenging tasks. This work studies how to effectively distribute and parallelize these pipelines at scale.
Tweet media one
1
0
5
@deeptir18
Deepti Raghavan
8 months
Some stages are stateful, meaning they have to aggregate partial outputs across a stream. For such cases we need to route all stream data through a consistent stage instance to ensure correct aggregation. We call this aggregation-aware routing.
Tweet media one
1
0
4
@deeptir18
Deepti Raghavan
8 months
We discuss some preliminary ideas on designing an interface to enable localized aggregation-aware routing and a distributed prompt-aware scheduling algorithm in our paper.
1
0
3
@deeptir18
Deepti Raghavan
5 years
Nice work @dmshanmugam !!!!!!!
@MIT_CSAIL
MIT CSAIL
5 years
Machine learning model uses your heartbeat to assess risk of cardiovascular death:
Tweet media one
1
38
93
0
0
2
@deeptir18
Deepti Raghavan
8 months
Two new challenges emerge when we stream partial outputs between pipeline stages: correctness and load balancing.
1
0
3
@deeptir18
Deepti Raghavan
8 months
Each LM stage can produce dynamic fan-out based on how many partial outputs it emits / how frequently the stage is invoked. To handle this fan-out and efficiently load balance across stages we need distributed prompt-aware scheduling.
Tweet media one
1
0
3
@deeptir18
Deepti Raghavan
8 months
We are actively looking for more applications to serve on top of ALTO. If you’re working on compound AI systems and want to serve them at scale, please reach out!
1
0
2
@deeptir18
Deepti Raghavan
8 months
@jaewon_chung_cs @matei_zaharia The streaming is when downstream tasks require some part of the LM output from the previous stage (not always at the granularity of a token). Claim extraction streams at the granularity of individual sentences to the query generation state, which generates a query per sentence.
1
0
2
@deeptir18
Deepti Raghavan
3 months
@qianl_cs Thank you @qianl_cs , this is very kind! I hope you will visit and come give a guest lecture :)
0
0
2
@deeptir18
Deepti Raghavan
2 months
@realDanFu Congrats Dan :)
0
0
1
@deeptir18
Deepti Raghavan
3 years
@schemeprincess Ooooo these cookies sound so good
1
0
1
@deeptir18
Deepti Raghavan
2 years
@kellycochra @otherskal @andrewkuznet @LizIzhikevich It should be open soon! We will post more details then.
0
0
1
@deeptir18
Deepti Raghavan
4 years
0
0
1
@deeptir18
Deepti Raghavan
3 years
0
0
1
@deeptir18
Deepti Raghavan
6 years
0
0
1
@deeptir18
Deepti Raghavan
5 months
@KonsKallas Congrats Konstantinos!!
1
0
1