Personal news: I recently got tenure from KAIST.
I’d like to thank everyone who has supported me along the way: my students, advisors, mentors, colleagues, collaborators, friends, and family.
It is double the excitement with Jihee, my wife, getting tenure at the same time.
I'm an Associate Professor now! (Still untenured in case you've been wondering. Need a few more years of the faculty grind.) Huge thanks to all my students, colleagues, mentors, and letter writers for being part of the journey. More than anything, I really enjoy this job. :)
Such an honor to give a keynote at
#NeurIPS2022
! I will talk about my vision for "interaction-centric AI" and how
#HCI
and
#AI
can work together to create valuable AI experiences in the real world.
Huge thanks to
@aliceoh
and the program chairs for the invitation.
Congrats to all the
#chi2023
authors for submitting their papers! Submission is a much more important milestone than acceptance. It's something we can control and decide. It signals how we produced something that passes our internal quality bar.
Eight papers from my research group
@kixlab_kaist
have been conditionally accepted to
#chi2024
. Many of them are LLM and Gen AI-powered interactive systems for supporting learning, design, and evaluation.
I now welcome a new Ph.D. to the world: Dr.
@minsuk_chang
! 🎓🎓🎓🎓🎓 Such a pleasure to have worked with a motivated, inspiring, and thoughtful student like him. It was a global thesis defense with 50 people joining from all parts of the world.
My first Ph.D. student
@minsuk_chang
is defending his thesis tomorrow, titled "Mining Sequential Knowledge for Interaction Design" with amazing committee
@aliceoh
@nekozzang
@roboticwrestler
& Mira Dontcheva. 10AM KST Sep 9. Let me know if you want to join over Zoom!
Pleasantly surprised by
#chi2022
results this year!
@kixlab_kaist
has six papers conditionally accepted with minor revisions and two papers with R&R. So proud of my students for their perseverance during the pandemic & grateful to collaborators for their contributions. (1/8)
<Summer Research Internship at
@kixlab_kaist
>
I'm looking for undergrad research interns to join my research group () this summer. Most projects this round are about human-AI interaction. Please share broadly!
Notifications for
#cscw2020
June submissions are out! Thank you all the reviewers, ACs, Editors, and my Papers Co-Chairs
@syardi
@SianLindley
for the amazing work handling 593 submissions. We have 47 Minor Revisions + 273 Major Revisions.
Thank you everyone for the kind words. It's been a few days full of anger & anxiety due to hostile & harassing language from an external person directly targeted at me & my students. I think I did the right thing by standing up & expressing why it's not okay and how I feel. (1/2)
Just sent out LBW notifications for
#chi2021
. We accepted 268 out of 688 (39.0% acceptance rate). We introduced anonymized submissions to LBW and believe it improved the overall process. A big thank you to all authors, reviewers, ACs, and my co-chairs
@eddiemelcer
& Katrin Wolf!
Two
#CHI2022
paper awards from
@kixlab_kaist
!
"Mobile-Friendly Content Design for MOOCs: Challenges, Requirements, and Design Opportunities" led by Jeongyeon wins a best paper award.
"Stylette: Styling the Web with Natural Language" led by Tae Soo wins an honorable mention.
Building human-centered LLMs requires moving beyond simple performance metrics. We introduce an LLM eval framework w/ 12 fine-grained skill sets, GPT-4 & human based evaluation methods, & comparison of SOTA LLMs on these dimensions. LLM eval is a great topic for NLP-HCI collabo.
Are open-sourced LLMs really good? 👀
We introduce FLASK🧪, a fine-grained evaluation based on skill sets! Even SOTA open-sourced LLMs such as LLaMA2 Chat 70B lag behind proprietary LLMs for some abilities. 🤯
Paper:
Demo:
Honored to have received a Grand Prize for Creative Teaching (창의강의대상) as part of the Outstanding Faculty Awards in Commemoration of KAIST's 49th Anniversary. I also had the pleasure of presenting my ideas and models about teaching in 2020 KAIST Education Innovation Day.
Due to COVID-19, ALL courses at KAIST will be given online, at least for the first few weeks of the spring semester until the situation improves. It's going to be a huge natural experiment for learning at scale. 1/3
📢Life/Career Update: I'll spend my sabbatical at Ringle, , a language learning startup with a video-based 1-on-1 tutoring service. I'll be in their Bay Area office from March to next February. Excited to go back to the Bay Area after 5.5 years!
I'm looking for undergrad research interns to join my research group
@kixlab_kaist
this winter. Join our active human-AI interaction research! Please share broadly.
#KAIST
is starting a new presidential postdoc fellowship.
@hcikaist
, an on-campus HCI research community with 20+ labs, is recruiting postdocs in all areas of
#HCI
. My group
@kixlab_kaist
has an open position too. Please share this broadly and recommend candidates! (1/2)
Wrote one of the most mentally exhausting emails in my entire career after 2 days of agony & sleep deprivation. Hope it works out. I'm so ready to take a rest, but it's 8am and time to start a workday full of meetings. Oh well, hope some of them restore my faith in humanity.
I was recently appointed as the inaugural "Educational Innovation Advisor" at KAIST, with the mission to promote, plan, and advise the use of AI in learning and teaching at KAIST. Excited about the opportunity to make an impact on KAIST education.
Sad I had to leave
#CHI2024
Wed morning. It was so good to be back to CHI after 5 years, catching up with old friends & colleagues and meeting new ones.
Tons of LLM-powered apps are built but few help users fluidly "experiment & iterate" w/ various configurations, limiting usability & utility. In our upcoming
#uist2023
paper we introduce "Cells, Generator, & Lenses", a design framework for LLM apps to easily add this support. 1/3
I feel honored to give my first conference keynote talk at
#HCOMP2021
! Excited to share some of the latest work we've been doing at KIXLAB in the space and my vision for the future of more organic and integrated crowdsourcing and human computation.
Incredible dichotomy: while we see a spike in num submissions, it's significantly more difficult to find reviewers. We got 60% more papers at
#cscw2020
vs 2019 and many ACs tell us have to send review invitations to 2-3 times more ppl.
A great showing of
@kixlab_kaist
at
#CHI2024
: we are presenting 9 full papers & 6 workshop papers on LLM/GenAI powered interactive systems for learning, design, decision making, paper recommendations, dataset generation, and evaluating LLM itself.
This is an online study room in Korea. People don't know each other. Participants must show their "hands" with their camera to indicate that they are studying. The moderator kicks people out once someone doesn't show their hand for a while. People pay to join these rooms.
Happy to announce that my group
@kixlab_kaist
has received a "Star Lab" grant from the Korean government. It'll support our "object-oriented video interaction" research for 8 years. What if we can author and watch videos with objects, relationships, & contexts than with frames?
<Summer Research Internship at
@kixlab_kaist
>
I'm looking for undergrad research interns to join my research group () this summer.
Many projects around designing and building novel human-AI interaction for various domains.
Dear
@ACM_CSCW
#cscw2022
community, I think we should consider making the deadline to sth like "the first Wednesday on or after Jan 15". A Sunday night deadline is brutal. 😭 I mean, I feel guilty as a CSCW2020 papers chair who introduced the 15th deadline but...
I'm lucky to be married to an award-winning economist
@thejiheekim
! "The Robert E. Lucas Jr. Prize is awarded biannually for the most interesting paper in the area of Dynamic Economics published in the Journal of Political Economy in the preceding two years."
JPE is happy to announce the 2021 Robert E. Lucas Jr. Prize winner. Congratulations to Professors Jones and Kim!
Charles I. Jones and Jihee Kim "A Schumpeterian Model of Top Income Inequality" ()
Giving myself a huge pat on the back for stepping down from a govt committee that I've known I didn't have time for but been holding onto for way too long due to FOMO & being terrible at turning down requests. Saying no is still hard after 4+ years on the job as faculty.
Finally done with my Papers Co-Chairing for
#cscw2020
. New quarterly submissions + virtual conference + pandemic made chairing particularly challenging, but I personally learned a lot. Huge thanks to my Co-Chairs
@syardi
@SianLindley
on Friday I closed up PCS and redirected authors to 2021 Chairs. After 22 months of planning, 3 submission cycles + revision rounds, 1000 papers, during a pandemic, I'm done w/ Papers Co-Chairing. It was fun! My Co-Chairs are lovely! I will now take a break.
#cscw2020
#cscw2021
These study with me videos are so interesting that we wrote a paper about them: "Personalizing Ambience and Illusionary Presence: How People Use “Study with me” Videos to Create Effective Studying Environments" to appear at
#chi2021
This college student has been live-streaming his daily study sessions for the past year, 12 hours straight, every day:
He’s not narrating or providing funny commentary like a typical Twitch streamer. It’s just: you watch him study, very intently!
New
#arxiv
preprint from
@kixlab_kaist
! When are people dissatisfied with
#ChatGPT
responses and why? How do they overcome them? We analyzed 511 dissatisfactory instances from 107 users and their detailed recollections.
#Alignment
and
#hallucination
are major usability issues.
Have you ever experienced dissatisfaction while using ChatGPT? How did you address this?
We explored users’ dissatisfaction with ChatGPT responses: types, resolving tactics, and the effect of knowledge level.
📃:
🏠:
(1/🧵)
Amazing
#cscw2020
+
#uist2020
panel featuring a per-decade walk-through of influential "systems research in collaborative and social computing" delivered orally by top HCI researchers. Can't believe
@jeffbigham
's Vizwiz is already 10 years old! I feel old.
#cscw2020
Call for Papers is out! We're introducing quarterly deadlines, with the first one on Oct 15, 2019. Papers accepted in the Oct 2019, Jan 2020, & Apr 2020 cycles will be invited to present at
#cscw2020
.
@syardi
@SianLindley
Lower registration + travel cost is surely one of the benefits of a virtual conference that can attract attendees from more diverse communities. I "sent" 15 students to
#CSCW2020
and
#uist2020
since it's virtual. No way this would have been possible if it were physical confs.
Most educational chatbots are designed to teach learners. What if we instead enable learners to teach a bot? Our
#CHI2024
paper w/ Honorable Mention award introduces techniques to simulate inquisitive learner behavior in LLM agents to aid human learning. Led by
@HyoungWookJin
.
🤖🧑🎓 Can students learn by teaching ChatGPT?
Our recent
#CHI2024
work explored the design space of using LLMs as teachable agents.
📄 Paper:
🛝 Interactive demo:
🌐 Project website:
Excited to have
@john_jyc
---a research scientist at Midjourney and a proud alum of
@kixlab_kaist
---in my Human-AI Interaction class () as a guest speaker. He's talking to us about "AI-powered Novel Interactions and Media for Creative Writing".
Virtual Zoom background with my co-chairs! I finally figured out the experience closest to standing on stage with my papers co-chairs for
#cscw2020
@syardi
@SianLindley
while giving a papers program overview.
"How to Write a CHI Paper?" workshop as part of HCIKorea2020 is a huge success with 100+ researchers in Korea. We have talks about paper writing & review process, case studies, & small group mentoring sessions. Thank you
@UichinLee
@JeanCrowdVision
@genialee
for organizing it!
Cheerful replies and messages from friends and those on Twitter whom I haven't even met gave me a lot of comfort and confidence. Even the ♥️ clicks to a tweet helped me feel I'm not alone. Thank you all and I'll try to be that caring person next time you are struggling! (2/2)
Bummed I couldn't make it to
#CHI2023
this year. I was on the fence till the last minute, but I had to face the truth: my plate's pretty full right now, and going would've just added more stress. These past few weeks have been a bit much, so I think I made the right call.
Evaluating whether language models meet ppl's expectations in billions of potential applications is a grand challenge. It inherently calls for a human-centered approach. Join us for this exciting
#CHI2024
workshop on human-centered evaluation of language models!
#NLProc
#LLM
#HCI
Working on
#LLMs
evalution and auditing?
📢 We are organizing the first workshop on Human-centerd Evalulation and Auditing of Language Models at
#CHI2024
. Joining us and build the community!
🗓️ Deadline: Feb 23
More info:
#HCI
#NLProc
The video of my
#NeurIPS2022
keynote on "Interaction-Centric AI" is finally publicly available. Happy to discuss & collaborate with people who find it relevant and interesting. Big thanks to
@aliceoh
for moderating the session.
Postdoc welcome & farewell lunch. Excited to welcome Dae Hyun Kim who recently finished his Ph.D. in CS at Stanford with the amazing
@magrawala
. A farewell to
@Iriskie_Xia
who will be heading to CMU for her second postdoc. I feel lucky to work with these awesome researchers!
A preliminary program for
#cscw2020
is out! More details to come but it's an exciting set of 210+ papers (5-min talks), keynotes, panels, demos, posters, workshops, DS, townhall, socials, and joint programs with
#uist2020
.
Really enjoyed talking with amazing SVs at
#chi2021
in the Pick-a-Brain session. Thanks for inviting & joining! As someone who SVed multiple times and attended these sessions, can't believe I'm in a position to share my experience. Shared counter-intuitive tips & plot twists: 1/2
"To truly scale, we need to incorporate different values & visions- that's when technology is successfully deployed"- Dr Juho(
@imjuhokim
) shares so many interesting perspectives from his research, teaching, & PhD days with
#CHI2021
SVs @ pick-a-🧠 session🙏
Andrew Head
@drewmikehead
(UPenn) visits KAIST and gives an awesome talk titled "Designing the Interactive Paper". He introduces systems that define terms, explain notation, enliven the static, & simplify the complex. Sadly I'm remote as a host while he's there in person. :)
My research group (KIXLAB) is looking for HCI research interns for the summer. We have projects in four sub-areas: interactive systems, social computing, AI & HCI, and large-scale data analysis.
Check out our new system that supports (1) evaluating LLM prompts and outputs on custom-defined and subjective criteria and (2) iteratively improving both the prompt and the criteria through a combination of auto and manual evaluation.
Improving LLM outputs is difficult because evaluating these outputs is difficult...
Introducing EvalLM ⚗️ - an interactive system for evaluating LLM outputs on user-defined and application-specific criteria 📏
🔗:
📄:
(1/n)
I'm looking for undergrad research interns to join my group () this winter. Longer visits could be arranged as well. HCI, social computing, online education, and data & ML for interactive systems!
MBZUAI is starting an HCI department led by
@xeeliz
. Great news for the HCI community! I heard active hiring will soon follow when I visited them for the AI quorum in Feb:
Much excitement in
#CSCW2019
's keynote and talks on human-centered ML and UX of ML! It's perfect time to advertise
@interactionsMag
's new
#UX
Meets
#AI
forum edited by
@hsmcramer
and me. Our first piece is out: "Confronting the Tensions Where UX Meets AI"
Closed 1,552 tabs from my phone, after 2.5 years of continuously opening new pages, stacking them, and never reading them. Feels so good! FOMO? Yes but I decided to treat them as completed rather than TODO tasks, as I feel I got 90% of why I need them upon opening them.
Ironic that after all these years of my own research in building systems for learning at scale and interactive online learning, I'm feeling like a newbie when it comes to doing this for my own class. Should revisit some of my own research to see if anything's applicable... 3/3
#LLM
can generate inconsistent responses even for the same prompt. This is bad, right? Well, it’s complicated and nuanced. In our upcoming
#FAccT2024
paper led by
@yoonjoo_le2
, we show that certain inconsistencies can indeed aid people’s comprehension.
🎉 Thrilled to share that our paper "One vs. Many: Comprehending Accurate Information from Multiple Erroneous and Inconsistent AI Generations” was accepted at
#FAccT2024
! 📊 Here's a thread on our findings and implications.👇 [1/7]
Paper:
Excited to share some of KIXLAB's latest research at
#CHI2020
with these conditionally accepted papers!
@hcikaist
Supporting chat-based discussion, enhancing streamer-viewer interaction in livestream, and understanding user perception of automated personality detection. (cont'd)
Excited about
@minsuk_chang
's new adventure at Naver as a research scientist, where he'll be setting up an HCI team and working at the intersection of HCI and AI. It's a great sign Naver is recognizing the importance of HCI in bringing AI to users. A proud advisor moment. :)
A bit late, but more personal news.
I started as a researcher at Naver AI Lab(). I’ll be setting up an HCI team (with the help and support of amazing colleagues) here at Naver. 1/n
After 10 mins of wrestling with screen projection, Jeongyeon is finally able to present our
#chi2022
paper "Mobile-Friendly Content Design for MOOCs: Challenges, Requirements, and Design Opportunities". Screen is yellow but oh well at least it's visible!
My (now online) Intro to HCI course now has a teaser image, created by an awesome TA
@yoon0u0
. Curious if it'll increase student engagement in Zoom...
I'm excited to announce that
@minsuk_chang
will be joining the
@GoogleAI
PAIR team next month as a Research Scientist, growing our research expertise in Human-AI Interaction!
In-class poll from my social computing course today.
-
#youtube
rocks.
-
#facebook
isn't as bad as I thought.
-
#TikTok
is not gaining traction.
- I over-estimated
#twitter
. Maybe it's just for academics showing off new papers.
- Campus community: Everytime is the new winner.
Excited for my upcoming virtual visit to UMich! Will share concrete examples of users interacting with AI systems in an unexpected, dynamic, and complicated manner, and discuss what it means to design these systems with users and their interaction at the center.
We're thrilled to virtually host Juho Kim
@imjuhokim
from KAIST to discuss “Interaction-Centric AI: Key to designing successful AI applications” on Nov 7, 11:45 AM ET. Please join us!
What a prolific year for
@kixlab_kaist
! Thanks to
@Dilrukshi_LK
for sharing this news even before me. :)
Number game in academia is toxic, & we understand what this kind of list means and doesn’t mean. I’d just like to thank students, collaborators, colleagues, & family.
🎭The
#CHI2022
program is out! Take a look at some
data and stats* of paper publications (by authors, institutions, cities, countries, and papers) here: .
@sigchi
@acm_chi
#whatTheHCI
* Yearly Disclaimer: stats not to be interpreted as "rankings".
I think we made the right decision. Surely a tough time to be a papers chair for
#CSCW
with the new quarterly submission model and now
#Covid_19
. Thankful to be part of a community with so many ppl who are thoughtful, open, and value diversity & inclusion.
#CSCW
- the deadline for new submissions AND for January Major Revisions is now June 1, *not* April 15. There will be no Apr 15 deadline. There will be no July 15 deadline. Please see for more information.
#cscw2020
At
#DIS2024
, we present AINeedsPlanner: a workbook to support effective collaboration between AI experts and clients. Upon analyzing AI app planning practices and info needs of AI experts, we developed a workbook that can be adopted in various AI app planning scenarios.
Looks like I posed for the photo too seriously 😅 It's been great working with
@eddiemelcer
& Katrin last few months to create
#CHI2021
's LBW program with nearly 300 papers. Anonymous submission + three-paper chatroom sessions for the virtual CHI were the main changes this year.
Introducing
#CHI2021
Late-breaking Work Chairs!
Juho Kim (
@imjuhokim
), Katrin Wolf, Edward Melcer
Juho (KAIST)
Katrin (Beuth University of Applied Sciences Berlin)
Edward (UCSC)
#CHI2021Organizers
My student
@minsuk_chang
gave a great talk on designing voice UI for how-to videos in the first session of
#chi2019
. Standing room only + lots of questions. Joint work bet. Adobe research, Stanford Univ., & KAIST, with Anh Truong, Oliver Wang,
@magrawala
Out of 146 submissions this quarter, we have 5 with "Accept with Minor Revision" (3.4%) and 64 with Major Revision (43.8%). Thank you all authors who submitted their great work to
#cscw2020
. Our next submission deadline is Jan 15, 2020.
The first ever quarterly cycle of
#cscw2020
reviews are out via email and in PCS! That was a lot of work. But the next cycle will be less work. Authors, reviewers, and ACs - if there is anything about your experience you think we should know, please email the Papers Chairs.
Tacit knowledge is crucial for skill mastery, yet it’s not explicitly spoken or documented, and is highly contextual and subtle. In this
#chi2024
paper w/ Honorable Mention recognition, we investigate tacit knowledge in graphic design. My PhD student
@kihoon_son
led the project.
Design has long been considered mysterious, driven by intuition and creativity🧐 But we set out to demystify it!
Our paper investigates designers' tacit knowledge and proposes guidelines for systems that can capture and share it
This work got an Honorable Mention 🏆
#chi2024
🧵
The amazing Prof. Xiaojuan Ma from HKUST is visiting KAIST and giving a talk titled “Empowering and Cultivating Users’ Higher-Order Thinking Skills with Human-Engaged AI: A Human-Centered, Data-Driven Approach”.
Sad to be missing
#UIST2019
@ACMUIST
this year, after attending 10 consecutive times since 2009. UIST2009 was my first ever academic conf where I met
@rbmllr
(my Ph.D. advisor) for the first time, UIST2013 I gave my first talk as first author (that's a long gap!), (cont.)
Prediction: We'll be seeing lots of positions like this from more companies in the near future, as more AI gets used to power user interaction and people realize model accuracy is only a small part of what really matters & integrating AI into UI is a significant challenge.
really excited to spread the word of this new Human Factors + ML researcher position on my broader team -- come work w/ great folks like
@foil
to consider the human experience throughout the development of AI/ML products & services ::
Check out who my next awesome colleague in SoC KAIST is. Welcome, Joseph! Looking forward to working closely with you. :) A huge win for
@hcikaist
for sure.
BTW, our department is continuing to hire faculty in all areas. International candidates are more welcome than ever.
Excited to host
@MarkWhiting
today in
@hcikaist
seminar: "Resetting remote team dynamics". He's talking about how he's been trying to unlock the mysteries of teamwork with sociotechnical designs & computational methods. Interesting fact: Mark has an MS degree from KAIST!
Check out our recent paper introducing a system that allows designers using
#GenAI
to (1) express their generation intent more precisely and (2) combine intent units to generate sketches. Led by
@daeun_choi_
Have you tried using GenAI for brainstorming your design ideas?🚀
🎨We propose CreativeConnect, a system with generative AI to help graphic designers ideate with reference recombination!
🔗
📄
So well-deserved. This project is a great model of academic research making great impacts on other fields and real-world users. I cover this project in both my HCI and social computing courses. Congrats to
@jeffbigham
and the team!
Super happy that I decided to come to
#UIST2023
to witness VizWiz
@jeffbigham
won the Lasting Impact Award! VizWiz is really an amazing project that inspired me and many of my peers. Congratulations!!
Excited to be at
#ICML2023
in Hawaii🌴 I’ll be presenting our paper “QASA: Advanced Question Answering on Scientific Articles”. We propose a benchmark consisting of QA pairs that require full-stack reasoning on scientific articles and a novel approach to answer these questions💡.
KIXLAB(
@kixlab_kaist
) is looking for undergraduate interns for the summer! We have a variety of projects spanning from online learning to human-AI interaction, and vehicle UX design :) apply for a great opportunity in HCI research!
Hello
#chi2021
folks! Check out my group's latest research on (1) supporting multimodal commenting in async collaboration, (2) understanding "study with me" videos, (3) enabling voice- and keyword-based how-to video navigation, & (4) improving video learning experience on mobile.
#CHI2021
Members of KIXLAB and collaborators will present 3 full papers and 1 late-breaking-work poster at CHI 2021. Most KIXLAB members will be attending CHI, so please say hi 👋
Super excited to have
@chinmay
in town to visit KAIST! His recent projects on communicating algorithms to users seem to have lots of system/interaction design implications.
Came to
#CSCW2020
a year too early in Minneapolis, as I'm stuck here for the night on the way to Austin for
#CSCW2019
. I didn't expect the MN coldness and snow in this trip but oh well I should be glad the plane I was on survived a lightning strike ⚡️⚡️⚡️ See you all tomorrow?
In about 24 hours, I'm giving a talk titled "Designing AI-Powered Interactive Systems: Towards Interaction-Centric AI" as part of The Academic Fringe Festival on "Designing at Scale with Human-AI Collaboration" hosted by
@UjLaw
@wisdelft
. Excited!